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PREFACE 


This  volume  describes  results  obtained  by  applying  ALSIM  to 
Miami,  Denver  and  LaGuardia  Airports  and  comparing  model  outputs 
with  field  observations.  Documentation  describing  the  usage  of 
the  model  and  program  details  is  contained  in  other  volumes  of 
the  Airport  Landside  Report.  Volume  I:  Planning  Guide  provides 
a  general  description  of  airport  capacity  analysis  and  the  use  of 
simulation  model  for  capacity  estimation.  Volume  II:  The  Airport 
Landside  Simulation  Model  (ALSIM)  Description  and  Users  Guide 
provides  a  general  description  of  program  logic,  assumptions  and 
program  input  and  output  data.  Volume  IV:  Appendix  A  ALSIM 
Auxiliary  and  Main  Programs;  and  Volume  V:  ALSIM  Subroutines 
provide  programming  details  of  the  model. 
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SUMMARY 


INTRODUCTION 

The  Airport  Landside  Simulation  Model  (ALSIM)  was  developed 
as  a  tool  for  the  dynamic  prediction  of  the  congestion  parameters 
occurring  at  landside  processing  facilities  at  airport  terminals. 
These  facilities  are:  enplaning  and  deplaning  curbsides,  parking 
facility  exits,  the  recirculation  roadway,  express  and  full  serv¬ 
ice  check-in  facilities,  security  stations,  gates,  custom  and 
immigration  facilities,  car  rental  counters  and  bag  claim  areas. 
Prior  to  application,  an  evaluation  was  undertaken  to  estimate  the 
model's  ability  to  predict  flow,  queue  length,  queueing  time  and 
occupancy  for  proposed  processor  configurations  and  operating 
conditions.  The  evaluation  process  consisted  of  calibration  and 
validation.  Calibration  is  the  process  of  adjusting  input  data 
parameters  to  establish  a  baseline  for  modeling  a  specific  airport 
Validation  is  a  testing  of  model  performance  over  a  range  of  oper¬ 
ating  conditions.  These  procedures  were  conducted  by: 

(1)  Planning  for  and  obtaining  data  at  existing  airports; 

(2)  Incorporating  calibration  data  into  the  model; 

(3)  Simulating  the  operations  of  the  landside  using  the  de¬ 
mand  placed  upon  the  system  for  the  observation  time 
period ; 

(4)  Comparing  the  model  outputs  with  validation  data  in  the 
form  of  time  series  of  flow  and  queue  lengths  observed 
at  the  processors. 

Within  this  general  framework,  several  subtasks  were  required 
to  complete  each  objective.  The  data  collection  task  required  the 
specification  of  the  data  items  to  be  obtained,  the  desired  amount 
of  data  tape  to  be  collected  and  the  selection  of  locations  to  be 
monitored.  The  model  calibration  included  logic  changes,  data  pre 
paration,  preliminary  testing  and  adjustment  of  parameters.  Val¬ 
idation  required  an  extensive  review  of  previous  efforts  and  sub- 
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sequent  development  of  a  suitable  methodology  for  comparing  field 
and  model  output  data. 

The  model  produces  simultaneous  flows  and  congestion  parameter 
statistics  at  all  designated  facilities.  Only  selected  facilities 
were  observed  in  order  to  keep  the  validation  data  collection  ef¬ 
forts  within  manageable  limits.  Program  resources  were  not  ex¬ 
pended  to  provide  validation  information  for  the  gate  processing 
counters  or  the  gate  lounge  areas.  Other  facilities  were  envi¬ 
sioned  as  more  critical  to  landside  operation  and  consequently  the 
observers  were  placed  at  those  locations. 

After  obtaining  and  reducing  the  field  data,  the  required  in¬ 
puts,  based  upon  the  observed  calibration  data,  were  prepared  for 
the  model.  A  limited  sample  of  the  validation  data  was  used  to 
check  the  operation  of  ALSIM  prior  to  validation  testing.  When 
ALSIM  was  applied  to  Miami,  an  extensive  series  of  corrections  and 
additions  ivere  required  to  bring  the  model  into  reasonable  con¬ 
formity  with  the  limited  sample  of  validation  data.  The  flight 
schedule  data  originally  obtained  from  the  major  carriers  operat¬ 
ing  at  Miami  had  to  be  augmented  by  flight  schedule  data  from  the 
smaller  carriers  and  even  from  the  OAG  schedule  when  otherwise 
unobtainable.  All  flights  with  an  actual  or  potential  loading  of 
at  least  50  passengers  were  simulated  to  achieve  approximate  agree¬ 
ment  of  field  and  simulation  data  at  security  stations.  The  model 
logic  required  extensive  correction  to  perform  correct  modal  as¬ 
signments  for  simulated  deplaning  passengers  and  for  simulated 
greeters.  Extensive  analysis  was  performed  to  specify  service 
times  at  landside  processing  facilities. 

The  model  was  operated  and  validation  testing  was  done  using 
data  from  several  processors.  These  included  full  service  and  ex¬ 
press  check-in  counters,  security  stations,  parking  facility  exits, 
customs  and  immigration  facilities.  The  bag  claim  field  data  for 
Miami  was  not  readily  interpretable  and  was  therefore  not  used. 

The  occupancy  counts  for  these  locations  obtained  from  the  ob¬ 
served  in/out  counts  produced  negative  values  at  times  and  were 
ignored.  The  validation  runs  were  then  produced  for  this  airport 
and  comparisons  of  the  calibrated  facilities  were  performed. 
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Calibration  and  validation  procedures  were  next  applied  to 
Denver.  The  model  results  were  not  subject  to  the  same  extensive 
checking  at  this  airport  prior  to  validation.  Curbside  flows 
were  investigated  in  addition  to  facilities  inside  the  terminal. 

The  numbers  of  vehicles  generated  by  ALSIM  were  significantly  less 
than  those  observed  suggesting  that  vehicles  not  directly  related 
to  each  originating  and  terminating  passenger  group  also  use  these 
facilities.  The  recirculation  roadway  flow  counts,  however,  were 
in  substantial  agreement  with  the  model. 

Subsequent  modeling  of  LaGuardia  Airport  substantiated  the 
lack  of  vehicular  demand  produced  by  the  model.  Airport  exit  and 
entrance  roadway  counts  were  nearly  double  those  produced  by  ALSIM. 

Due  to  the  effort  expended  on  the  Miami  terminal  facilities 
modeling,  the  lack  of  adequate  data  for  the  bag  claim  there,  and 
the  subsequent  disparities  in  vehicular  flow  data  at  the  second 
and  third  airports,  bag  claim  processing  was  not  subject  to  val¬ 
idation.  The  car  rental  counters  were  not  validated  either. 

During  the  execution  of  the  validation  procedure  a  number  of 
approaches  were  rejected  after  examining  the  data.  The  standard 
t,  f  and  X*-  tests  were  rejected  because  of  the  serial  dependence 
occurring  between  successive  data  samples.  Regression  of  field 
and  simulated  data  was  tried  but  subsequently  abandoned  because 
the  slope  and  intercept  values  obtained  could  not  be  interpreted. 
Regression  has  also  been  shown  to  be  inapplicable  to  stochastic 
simulations  in  a  paper  by  Aigner.*  Although  Aigner's  analysis 
was  applied  to  time  dependent  econometric  models,  it  is  suffi¬ 
ciently  general  to  include  ALSIM.  The  approach  finally  chosen  is 
independent  of  the  nonstationary  and  serially  correlated  features 
of  the  data. 


*Superscr ipt s  refer  to  Summary  References  at  end  of  Summary. 
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In  summary,  although  the  baggage  claim,  car  rental  facility 
and  rate  areas  were  not  tested  it  is  felt  that  a  good  representa¬ 
tion  of  other  landside  processing  facilities  inside  the  terminal 
building  and  at  the  parking  facility  exit  can  be  attained  by  this 
model.  The  curbside  processes  require  a  better  representation  of 
demand  and  more  refined  logic  to  simulate  lane  blockage  due  to 
double  parking  and  vehicular  queueing. 

The  airports  selected  as  a  basis  for  evaluating  ALSIM  were 
Miami  International,  Denver  Stapleton  and  LaGuardia.  Factors  in¬ 
volved  in  choosing  these  sites  were: 

1.  Large  passenger  volumes  -  The  intent  of  the  evaluation 
was  to  determine  model  performance  characteristics  when 
applied  to  airports  of  most  likely  future  interest. 

2.  A  relatively  simplified  geometry  -  For  these  airports, 
the  landside  consisted  of  a  single  terminal  building  with 
independent  enplaning  and  deplaning  curbsides  and  a 
parking  facility.  Passenger  transfers  for  this  geometry 
are  generally  accomplished  by  walking,  thus  eliminating 
the  necessity  of  modeling  a  shuttle  system  for  transfers. 
Placement  and  monitoring  of  observers  for  this  geometry 
were  also  straightforward.  Although  the  Eastern  Shuttle 
operation  at  LaGuardia  is  removed  from  the  main  terminal, 
the  low  percentage  of  transfer  passengers  at  this  airport 
allowed  modeling  of  the  two  terminals  as  independent 
operations  with  the  exception  of  vehicular  traffic  flow. 
It  is  also  recognized  that  several  parking  facilities 

are  present  at  LaGuardia.  For  the  effort,  vehicles  were 
grouped  into  two  categories,  those  using  the  main  ter¬ 
minal  and  those  using  the  shuttle. 

3.  A  diversity  of  operational  characteristics  -  These  will 
test  model  behavior  over  differing  conditions.  Miami 
International  processes  a  substantial  international 
passenger  volume  with  pronounced  peaking  of  passenger 
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traffic.  A  large  volume  of  deplanements  occurs  near 
noon  and  an  enplanement  peak  follows  shortly  thereafter. 
Approximately  25  percent  of  the  passengers  are  transfers. 

Denver  Stapleton  is  characterized  by  a  large  percen¬ 
tage  of  transfers,  with  approximately  50  percent  of  the 
passengers  in  this  category.  The  international  traffic 
is  extremely  small  and  was  ignored  for  the  validation 
process.  Peaking  of  demand  is  not  as  pronounced  as  Miami, 
but  a  series  of  alternating  groups  of  inbound  and  subse¬ 
quent  outbound  flights  are  scheduled  by  some  airlines  to 
accommodate  intraline  transfers. 

At  LaGuardia  Airport,  approximately  11  percent  of 
the  passengers  are  interline  transfers.  Demand  peaking 
is  much  less  pronounced  at  this  airport  than  at  the  other 
two.  The  hourly  distribution  of  demand  exhibits  a  steady 
increase  from  3.5  percent  of  total  daily  passengers  at 
7  A.M.  to  8.5  percent  at  7  P.M.  The  percentage  remains 
constant  for  the  next  hour,  then  declines  rapidly  and 
steadily  to  zero  by  midnight.  No  international  traffic 
is  present  at  LaGuardia. 

Passenger  demand  and  operating  characteristics  exhibited  at 
these  three  airports  were  believed  to  provide  as  great  a  range  in 
magnitude  of  the  input  variables  associated  with  these  categories 
as  expected  in  ALSIM  application.  An  airport  geometry  consisting 
of  several  unit  terminals  requiring  transporters,  people  movers, 
or  shuttle  vehicles  for  passenger  movement  would  represent  the 
next  significant  degree  of  complexity. 

Validation  Procedures 

A  series  of  tasks  required  for  validation  of  the  Airport 
Landside  Simulation  Model  were  undertaken  during  1978  to  1980. 

These  included  the  following: 

1)  Determination  of  a  methodology  for  model  testing. 

2)  Verification  of  computer  code. 
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3)  Collection  and  reduction  of  airport  data  for  model  cali¬ 
bration  and  validation. 

4)  Model  calibration  and  validation. 

1 .  Model  Testing  Methodology 

The  general  objective  of  validation  procedure  for  ALSIM  is  the 
demonstration  of  the  extent  of  agreement  between  model  outputs  and 
corresponding  data  obtained  at  an  airport.  Data  most  readily  ob¬ 
served  for  this  purpose  are  time  series  of  flow  and  queue  length 
at  passenger  processing  facilities.  Included  in  these  processor 
types  are  curbside,  ticket  counters,  security  stations,  bag  claim 
areas,  car  rental  counters  and  parking  facility  entrances  and 
exits . 

The  model  is  capable  of  producing  time  series  data  for  direct 
comparison  with  field  observations.  Selection  of  a  suitable  com¬ 
parison  test  is  necessary  to  provide  as  widely  accepted  a  criterion 
as  possible  and  to  avoid  violation  of  major  assumptions  underlying 
the  application  of  a  test. 

The  nature  of  both  the  field  data  used  for  model  comparison 
and  the  simulation  outputs  greatly  influence  selection  of  a  test¬ 
ing  methodology.  Both  data  types  exhibit  autocorrelation,  the 
serial  dependence  of  one  time  series  data  point  on  its  predeces¬ 
sors,  and,  non - s tat ionar itv ,  a  significant  change  as  a  function 
of  time,  in  the  magnitudes  of  statistical  parameters  describing 
the  data.  A  choice  of  a  suitable  methodology  is  further  compli¬ 
cated  by  the  use  of  random  number  generation  for  ALSIM  to  produce 
service  times  at  facilities  and  to  assign  passenger  characteris¬ 
tics.  The  model  is  thus  partly  a  Monte  Carlo  simulation  and 
partly  deterministic,  because  of  the  flight  schedule  used  to  rep¬ 
resent  fluctuating  demand. 
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Autocorrelation  in  the  data  influences  the  calculated  esti¬ 
mate  of  the  variance  and  nullifies  the  use  of  standard  x2  »  t  and  F 
statistics  for  comparison  testing  purposes.  A  methodology  for 

comparison  of  autocorrelated  data  series  has  been  developed  using 

2 

autoregression  techniques  but  is  only  applicable  to  stationary 
data.  The  behavior  of  the  data  more  closely  resembles  that  repre¬ 
sented  by  autoregressive  integrated  moving  average  processes^ 
for  which  there  are  presently  no  statistical  testing  methods 
avai lable . 

The  use  of  regression  for  model  validation  has  been  suggested. 
The  methodology  consists  in  regressing  the  field  data  time  series 
onto  the  mode  1 - generated  series.  A  two  part  test  follows  from 
this  approach:  a  test  that  the  intercept  of  the  regression  equa¬ 
tion  differs  significantly  from  zero  and  a  test  that  the  slope  of 
the  regression  differs  significantly  from  one. 

For  a  stochastic  simulation,  the  slope  of  the  regression  line 
is  dependent  upon  the  variance  of  a  random  variable  representing 
uncertainties  or  missing  input  variables.  The  slope  of  the  re¬ 
gression  line  is  inversely  dependent  upon  this  variance,  and  for 
a  stochastic  simulation  this  term  is  non-zero. 

Thus,  any  hypothesis  test  based  upon  demonstrating  that  there 
is  no  evidence  to  indicate  the  slope  of  the  regression  is  not 
unity,  should  not  be  attempted. 

The  methodology  used  for  testing  ALSIM  avoids  the  nonstation- 
arity  and  serial  dependency  features  of  the  data.  Time  series 
values  are  not  tested  directly,  instead,  the  percentage  of  times 
that  the  field  data  is  within  a  specified  interval  of  the  simula¬ 
ted  mean  becomes  the  random  variable  to  be  tested.  The  simulation 
mean  referred  to  is  the  mean  value  of  an  output  variable  at  a 
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specified  time  point.  This  mean  value  is  obtained  by  producing  a 
series  of  ALSIM  runs  with  a  fixed  set  of  input  data  but  a  different 
random  stream  for  each  run.  Thus,  a  unique  realization  of  the 
landside  processes  is  produced  for  each  replication.  At  any  time 
point,  the  mean  and  standard  deviation  of  output  values  produced 
by  the  set  of  runs  may  be  calculated.  The  statistical  parameters 
obtained  at  each  time  point  by  this  process  arise  from  data  which 
is  independent  and  necessarily  stationary. 

At  each  time  point,  it  may  be  determined  if  the  field  value 
is  within  one  or  two  simulated  standard  deviations  of  the  simula¬ 
tion  mean  value.  Over  a  run  of  an  arbitrary  time  length,  the  per¬ 
centage  of  occurrences  of  field  data  within  the  specified  limits 
may  be  calculated.  For  a  given  number  of  points  used  in  the  mean 
value  calculation,  a  percentage  of  values  within  one  or  two  stand¬ 
ard  deviations  may  be  specified  a  priori  if  a  Student  distribution 
is  assumed.  This  percentage  will  be  taken  as  the  probability  of 
success  of  a  Bernoulli  trial  at  each  time  point.  Furthermore,  a 
region  of  acceptance  for  a  specified  percentage  and  number  of 
trials  can  be  established,  and  the  percentage  of  points  actually 
obtained  during  the  comparison  period  may  be  tested  for  occurrence 
within  the  region  of  acceptance. 

Prior  to  any  testing  of  this  type,  plots  comparing  the  simula¬ 
tion  mean  and  field  values  on  a  common  set  of  axes  are  performed. 

If  there  is  obviously  no  chance  for  agreement  no  further  testing 
or  comparison  is  performed. 

2.  Verification  of  Computer  Code 

The  model  was  checked  for  computer  code  accuracy  by  examining 
GPSS  block  counts  at  the  end  of  a  sample  run.  The  numbers  of 
transactions  passing  through  program  locations  were  compared  to 
those  expected  at  each  location  based  upon  routing  assignments 
and  input  percentages  modifying  these  routings.  A  minor  coding 
error  was  detected  and  corrected  by  this  check. 
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3.  Collection  and  Reduction  of  Airport  Data  for  Model  Calibration 
and  Validation 

Data  was  collected  by  stationing  observers  at  several  loca¬ 
tions  throughout  the  landside  for  simultaneous  observation  of 
flows,  queue  lengths,  and  queue  times.  Surveys  were  conducted  at 
Miami  International  Airport  on  March  17  and  18,  1978,  at  Denver 
Stapleton  Airport  on  April  13  and  14,  1978  and  LaGuardia  Airport 
on  May  24  and  25,  1978.  Details  of  the  data  collection  program 
are  contained  in  the  report  "Collection  of  Calibration  and  Valida¬ 
tion  Data  for  an  Airport  Landside  Dynamic  Simulation  Model"  (FAA- 
EM-80-2),  April  1980.  The  flight  schedules  used  for  calibration 
and  validation  program  inputs  were  also  obtained  at  these  airports 
during  these  periods.  Other  calibration  data  was  reduced  to  fre¬ 
quency  distributions  for  conversion  to  program  inputs. 

4.  Model  Calibration  and  Validation 

Procedures  used  to  test  and  compare  ALSIM  outputs  and  corres¬ 
ponding  field  data  differed  considerably  between  Miami  Airport  and 
the  two  others.  At  Miami,  an  extensive  calibration  procedure  con¬ 
sisted  of  placing  input  data  derived  from  field  observations  into 
The  model,  testing  outputs  against  field  data  over  a  specified 
simulation  time  period,  then  modifying  inputs  or  program  logic  to 
improve  agreement.  ALSIM  was  then  rerun  with  the  updated  values 
or  modified  logic  statements  and  retested.  After  a  number  of 
reiterations  of  testing  and  modifying,  when  the  simulation  and 
field  data  were  as  close  as  possible,  and  further  modifications 
appeared  counter-productive  because  of  questionable  field  data  or 
unwanted  disturbances  of  model  results  from  successfully  calibra¬ 
ted  related  facilities,  the  calibration  period  was  ended. 

Validation  consisted  in  modeling  the  operation  of  the  airport 
for  a  time  period  differing  from  the  calibration.  No  further 
changes  were  made  in  model  logic  or  input  data.  The  flight  sched¬ 
ule  representing  the  demand  for  the  validation  period  was  input  to 
the  model.  Model  outputs  were  compared  to  the  corresponding  field 
data  of  the  validation  period.  At  Miami,  the  calibration  period 
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was  from  1130  to  1400  on  March  18.  The  validation  period  extended 
from  1400  to  1700  on  the  same  day. 

During  the  calibration  period,  a  number  of  sets  of  model  repli¬ 
cations,  each  consisting  of  five  runs,  were  performed.  From  each 
set,  a  mean  and  standard  deviation  of  flow  and  queue  length  were 
obtained  at  each  time  point.  Mean  simulated  values  versus  time  and 
field  values  versus  time  were  plotted  on  the  same  pair  of  axes. 

These  plots  permit  a  visual  examination  of  agreement  or  disagree¬ 
ment  between  the  two  time  series.  Plots  depicting  the  flow  and 
queue  length  results  for  the  final  set  of  calibration  runs  are 
exhibited  in  the  body  of  the  report.  The  number  of  points  of  field- 
obtained  flow  values  within  one  and  two  simulated  standard  devia¬ 
tions  of  the  simulated  mean  are  also  shown. 

The  same  comparisons  were  performed  for  the  validation  period. 
During  this  time  period  only  one  set  of  five  replications  was  per¬ 
formed.  The  plotted  and  numerical  results  are  also  exhibited  in 
the  report. 

The  simulated  mean  and  standard  deviation  at  each  time  point 
are  assumed  to  arise  from  a  Student  t  distribution  with  four  degrees 
of  freedom.  If  the  simulation  parameters  represent  the  dis¬ 
tribution  of  values  at  each  time  point,  the  probability  that  the 
field  data  lies  within  2  standard  deviations  is  87  percent.  Assum¬ 
ing  this  probability  to  remain  constant  through  the  validation  time 
period,  a  significance  test,  based  upon  the  binomial  distribution, 
may  be  established.  The  normal  deviate,  identical  to  Chi-Square 
with  one  degree  of  freedom,  is  used  to  test  significance.  The 
null  hypothesis  is  that  the  proportion  of  successes,  the  occurr¬ 
ences  of  the  field  points  within  two  simulated  standard  deviations 
of  the  simulated  mean,  is  from  the  same  population  as  the  theoreti¬ 
cal  87  percent.  Using  a  correction  for  continuity  (3),  the  normal 
deviate  is: 

zt  =  C|  P -p |  -  n/2  /  /pqn) . 

At  the  95  percent  level  of  significance,  the  value  of  zt  is 
1.96  or  less  for  the  hypothesis  to  be  accepted. 
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Using  the  values,  p  *  87,  q  =  13  and  n  *  24,  the  region  of 
acceptance  for  p  is  the  following: 

0.71  <  p  <  1. 

Thus,  for  validation  only,  those  facilities  indicating  71 
percent  or  greater  as  a  percentage  of  points  within  two  standard 
deviations  are  accepted  as  adequately  representing  flow. 

The  same  tests  were  not  conducted  for  queue  length,  because 
visual  agreement  was  not  generally  obtained.  Reasons  for  dis¬ 
parities  are  noted  in  the  text. 

Table  S-l  indicates  results  of  the  validation  for  Miami  flow. 
Those  validation  values  within  the  95  percent  acceptance  region 
are  noted  by  an  asterisk. 

At  Denver  and  LaGuardia,  the  simulation  was  only  calibrated 
by  using  values  obtained  directly  from  field  observations.  A  set 
of  five  runs  were  made  and  the  output  values  compared  to  field 
values.  Gross  errors  in  input  were  corrected  and  ALSIM  was  rerun 
to  produce  a  final  set  of  five  replications.  The  validation  period 
extended  from  1400  to  2000  April  13  for  Denver  and  from  1400  to 
2000,  May  25  for  LaGuardia.  Hourly  flow  values  were  compared  and 
percentage  differences  between  field  and  simulated  values  noted. 

The  results  are  presented  in  the  body  of  the  report  text. 

CONCLUSIONS  AND  RECOMMENDATIONS 

A  testing  methodology  applicable  to  data,  which  is  autocor- 
related  and  nonstationary,  has  been  used  to  evaluate  ALSIM.  This 
procedure  consisted  of  producing  a  series  of  five  replications  and 
determining  if  the  field  data  was  within  plus  or  minus  two  standard 
deviations  of  the  simulated  mean  at  each  time  point.  The  number  of 
occurrences  was  tested  for  significance  against  the  theoretical 
value  of  87  percent.  A  number  of  facilities  provided  good  flow 
agreement  between  field  and  simulated  values  based  upon  this  test. 

In  a  number  of  other  facilities,  reasons  for  discrepancies  have 
been  pointed  out.  The  simulation  is  capable  of  producing  accurate 
values  for  predict ing  the  onset  and  duration  of  congestion  if  it  is 


TABLE 


-1.  PERCENTAGE  OF  FIELD  DATA  POINTS  WITHIN 

TWO  STANDARD  DEVIATIONS  OF  THE  SIMULATED 
MEAN ; MIAMI  INTERNATIONAL  AIRPORT 


EAL  TICKET 

20 

SOUTHERN/TWA  TICKET 

58 

EAL  EXPRESS  CHECK 

58 

CONCOURSE  B  SECURITY 

88* 

CONCOURSE  C 

67 

CONCOURSE  D 

79* 

CONCOURSE  E 

96* 

CONCOURSE  F 

75* 

CONCOURSE  G 

75* 

CONCOURSE  H 

100* 

CUSTOMS 

63 

IMMIGRATION 

75* 

PARKING  FACILITY  #1 

42 

PARKING  FACILITY  *4 

$  5  83* 

‘Values  within  the  acceptance  region 
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used  with  attention  to  input  details,  especially  in  specifying  the 
number  of  servers  at  each  facility.  ALSIM  presupposes  the  exist- 
ance  of  an  input  schedule  which  accurately  projects  the  anticipated 
landside  demand. 

In  summary,  given  the  computational  efficiency  of  the  model, 
it  is  a  relatively  inexpensive  and  accurate  tool  to  aid  the  airport 
developer  and  planner. 
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1.  INTRODUCTION 


Validation  is  a  process  of  evaluation  that  is  intended  to 
determine  how  well  a  model  can  produce  expected  results.  This 
process  generally  requires  a  comparison  of  data  produced  by  the 
model  with  corresponding  data  from  the  system,  if  it  exists,  or 
from  a  suitable  substitute  if  the  system  is  purely  conceptual. 

The  evaluation  is  intended  to  identify  the  model's  strengths, 
weaknesses,  and  applicability  as  well  as  possible. 

There  is  no  uniformly  acceptable  measure  of  a  model's  valid¬ 
ity.  One  commonly  used  measure  is  the  probability  that  the  model 
is  in  error  by  less  than  a  given  amount,  or  conversely,  the  amount 
of  error  that  can  be  expected  with  a  certain  degree  of  confidence 
(probability).  By  way  of  example,  one  might  claim  that  a  model 
output  is  correct  to  within  10  percent  over  95  percent  of  the 
time  (or  with  95  percent  confidence).  Clearly,  if  a  model  has 
several  outputs,  each  must  have  its  own  measure  of  validity. 

Degree  of  error  is  not  the  only  measure  of  a  model's  valid¬ 
ity,  and  in  some  cases  may  be  quite  irrelevant.  Consider,  for 
example,  the  case  depicted  in  Figure  1-1.  The  modeled  "y"  takes 
approximately  the  same  path  as  the  actual  "y" ;  however,  it  occurs 
at  a  faster  rate.  In  many  ways  this  might  be  considered  a  very 
poor  model--it  has  large  absolute  errors  and  it  predicts  peaks 
when  there  are  valleys,  and  vice  versa.  However,  it  provides 
some  information  quite  accurately,  such  as  the  height  of  the 
peaks  and  the  depths  of  the  valleys,  and  their  relative  location 
over  time.  If  the  ticks  on  the  time  axis  represent  years  or  de¬ 
cades,  then  the  progress  of  "y"  can  be  monitored  over  time  and 
the  model  will  provide  useful  information  in  planning  for  "y" . 
However,  if  the  ticks  on  the  time  axis  represent  seconds,  and 
planning  for  "v"  must  be  completed  over  a  much  longer  period,  the 
model  is  practically  useless. 

Another  example  is  shown  in  Figure  1-2.  In  this  case  the 
model  is  out  of  phase  with  reality.  However,  if  the  amplitude  of 


1-1 


1-3 


MvM  is  the  only  matter  of  interest,  the  model  is  quite  adequate. 
The  phase  shift  is  a  sign  that  something  is  inherently  wrong  with 
the  model;  however,  that  error  appears  to  be  systematic  and  may 
not  affect  the  model's  validity  for  certain  applications. 

A  final  example  is  shown  in  Figure  1-3A.  Here,  it  appears 
that  a  factor  not  considered  in  the  model  has  affected  "y"  at 
one  point  in  time.  Nevertheless,  at  every  other  point  the  model 
accurately  forecasts  the  change  from  period  to  period,  as  shown 
in  Figure  1-3B.  If  the  process  of  "y"  can  be  measured  in  real 
time,  and  if  "v"  is  planned  for  from  one  period  to  the  next,  then 
the  model  is  highly  valid  for  this  application. 

Although  wide  tolerance  limits  may  be  set,  one  cannot  ignore 
clearly  erroneous  model  outputs  even  if  those  outputs  are  not 
pertinent  to  the  decisions  being  made.  In  the  examples  cited 
above -- inaccurate  time  tracking,  inaccurate  phase  prediction,  and 
incomplete  specif ication- -there  is  a  flaw  in  the  conceptual  struc¬ 
ture  of  the  model  that  may  ultimately  affect  outputs  of  interest. 
In  such  cases,  it  is  necessary  to  determine  what  the  flaw  is,  or 
why  the  model  is  "inaccurate."  Sometimes  the  flaw  cannot  be 
corrected.  For  example,  it  may  be  due  to  random  fluctuations  of 
a  variable  which  cannot  be  forecast.  In  other  cases  it  can  be 
corrected,  and  it  should  be.  In  either  case,  when  flaws  exist, 
it  is  imperative  that  the  model  user  understand  their  nature  k  .d 
their  cause  in  order  to  understand  properly  their  impact  on  the 
output  measures  of  interest.  Although  a  model  has  correctly 
forecast  outputs  of  interest  in  the  past,  basic  structural  errors 
could  affect  the  accuracy  of  such  outputs  in  the  future. 

In  summary,  it  is  apparent  that  the  accuracy  of  each  model 
output  must  be  assessed,  but  that  the  type  of  assessment  must 
vary  by  output.  For  those  variables  which  are  most  sensitive  to 
design  parameters,  and  upon  which  airport  design  is  based,  vari¬ 
ables  such  as  average  and  maximum  queue  length,  the  model's  pre¬ 
dictive  ability  must  be  assessed  quantitatively  so  that  the  user 
can  determine  how  to  weigh  the  model  outputs  against  other  fac¬ 
tors  entering  into  the  decision  process.  For  other  variables,  a 
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more  qualitative  assessment  of  accuracy  is  required  for  the  pur¬ 
pose  of  assessing  the  modelfs  structural  validity. 

There  are  three  major  sources  of  error  contributing  to  model 
degradation.  These  are: 

1.  Incomplete  scope;  missing  components. 

For  the  landside  simulation  this  may  consist  of  not  including 
a  processing  module  in  the  model  or  failure  to  model  correctly  the 
routing  of  a  significant  number  of  passengers  through  a  processor. 

2.  Input  mi s -est imat i on . 

Demand  and  service  characteristics  are  specified  by  model  in¬ 
put  data.  The  effect  of  errors  in  both  types  of  data  may  be  sig¬ 
nificant.  For  example,  although  it  may  appear  advantageous  to 
ignore  flights  of  less  than  50  persons  when  specifying  input 
flight  data,  significant  flow  and  queueing  errors  at  security  sta¬ 
tions  were  evidenced  with  these  omissions  and  required  correction. 

3.  Initial  conditions  improperly  quantified. 

ALSIM  models  conditions  that  contain  an  inherent  dependency 
between  succeeding  time  periods.  Thus,  initial  conditions  that 
are  improperly  quantified  can  produce  simulated  long  lasting 
effects  and  not  properly  represent  the  congestion  at  a  processor. 

The  evaluation  process  for  the  Airport  Landside  Simulation 
Model  has  required  a  series  of  tasks.  These  were: 

1.  Determination  of  methodology  for  model  testing. 

2.  Verification  of  computer  code. 

3.  Collection  of  airport  data  for  model  calibration  and 
validation. 

4.  Model  calibration  and  validation. 

The  remainder  of  this  chapter  discusses  these  topics  and 
provides  results  of  model  validation  at  Miami,  Denver,  and 
LaGuardia  Airports. 
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2.0  DETERMINATION  OF  METHODOLOGY 


The  selection  of  a  methodology  for  model  testing  depends  on 
the  the  nature  and  proposed  application  of  the  model.  This  simula¬ 
tion  is  intended  to  determine  airport  landside  capacity,  and  to 
analyze  the  occurrence  of  congestion  at  facilities.  The  landside 
capacity  is  determined  by  operating  the  model  at  a  fixed  demand 
rate  for  an  extended  time  period.  The  model  will  determine  the 
magnitude  of  a  level-of-service  parameter,  e.g.,  waiting  time  per 
passenger,  versus  the  number  of  passengers  using  the  system  in  a 
specified  time  period.  A  series  of  values  of  waiting  time  for 
increased  demand  levels  is  plotted  and  the  magnitude  of  passenger 
flow  at  a  predetermined  level  is  the  designated  capacity. 

Unfortunately,  this  approach  does  not  work  well  as  a  basis 
for  model  testing.  The  airport  landside  does  not  operate  under  a 
fixed  demand  rate  for  an  extended  time  period  and  congestion- 
related  periods.  Furthermore,  capacity  curves  are  established 
for  a  fixed  set  of  geometric  and  service  characteristics.  In 
actuality,  service  characteristics  of  the  facilities  change  as  the 
number  of  agents  increases  or  decreases  in  time. 

The  testing  of  model  suitability  for  analyzing  or  predicting 
the  occurrence  of  congestion  must  be  performed  by  observing 
existing  airport  operations.  Although  an  ideal  methodology  for 
validation  of  the  capacity  analysis  capability  of  ALSIM  would 
consist  in  obtaining  data  each  day  at  a  peak  congestion  period 
thereby  obtaining  stationary  and  independent  data,  this  is  im¬ 
practical  on  an  airport-wide  basis. 

The  approach  taken  for  ALSIM  validation  has  consisted  of 
performing  observations  of  airport  landside  operations  over  an 
extended  continuous  time  period  including  peak  and  slack 
demand.  Observations  were  made  of  flow  and  queue  length  for 
several  processors  simultaneously  at  predetermined  intervals. 

The  model  is  capable  of  producing  output  values  as  frequently 
as  the  field  data  observations  were  taken  and  thus  provided  a 
time  series  of  data  points  for  comparison.  This  approach  does 
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require  the  selection  of  an  appropriate  methodology  for  comparing 
the  resultant  field  and  model  time  series, 

The  important  test  is  to  be  able  to  demonstrate  the  capabil¬ 
ity  of  the  model  of  predicting  the  onset,  magnitude,  and  duration 
of  congestion  at  a  specified  facility.  Two  principles  influence 
the  selection  of  an  appropriate  test.  First,  the  forecasting 
power  of  the  model  is  judged  primarily  by  determining  if  the 
discrepancy  between  the  field  and  simulated  data  is  consistent 
with  the  uncertainty  inherent  in  the  model.  This  uncertainty  is 
expressed  by  the  Monte  Carlo  nature  of  the  model.  The  demonstra¬ 
tion  of  validity  should  display  an  absence  of  bias  errors  in  the 
model  and  indicate  that  unusual  simulation  events  are  rare. 

The  second  consideration  to  be  taken  into  account  is  the 
time  varying  nature  of  the  data.  Any  test  comparing  field  and 
simulated  data  should  not  destroy  the  temporal  structure  of  the 
data  sets.  The  examination  of  time  point  value  accuracy  can  be 
used  to  uncover  flaws  in  the  model  structure  independent  of 
application.  For  example,  service  rates  at  a  given  facility  may 
be  consistently  overestimated  at  one  time  of  the  day  and  consist¬ 
ently  underestimated  at  another.  This  might  indicate  that  the 
facility’s  service  time  is  not  best  modeled  with  a  mean  and 
variance,  as  may  have  been  assumed  a  priori ;  but  rather  by  a  mean, 
variance,  and  some  other  parameter,  such  as  flow  rate  or  queue 
length.  Alternately,  for  example,  one  might  observe  that  the 
error  in  the  service  rate  is  not  correlated  with  any  parameter, 
but  rather  appears  to  be  a  function  solely  of  the  staffing  levels 
at  the  facility.  One  could  then  adjust  the  model  to  reflect 
this  by  randomly  adjusting  the  number  of  servers  as  a  function 
of  time  through  input  data. 

Two  statistical  considerations  modify  any  approach  taken  to 
demonstrate  model  validity  by  comparison  of  model  output  with 
field  data.  These  are:  (1)  non- s t at ionari ty  and  (2)  auto¬ 

correlation  in  the  data.  Both  affect  the  applicability  of  any 
test  based  on  assumption  of  stationaritv  and  independence. 


The  model  and  field  data  both  exhibit,  at  different  times, 
positively  and  negatively  sloped  trends  indicating  that  the  mean 
value  of  a  set  of  data  points  from  one  time  period  differs 
significantly  from  that  of  another  time  period.  This  suggests, 
but  does  not  necessarily  prove  non- stationarity  of  the  data. 

Strict  stationarity  in  a  qualitative  sense  means  that  the  proba¬ 
bility  laws  describing  the  phenomena  at  one  time  point  is  identi¬ 
cal  to  that  at  any  subsequent  point  in  the  time  series.  Because 
of  the  behavior  of  the  landside  data,  stationarity  does  not 
appear  present.  Mean  values  fluctuate  from  time  point  to  time 
point  and  presumbly  variances  undergo  similar  changes. 

Auto-correlation  in  the  data  is  a  recognized  feature  of 
simulation  model  outputs  and  corresponding  field  observations. 

This  is  exhibited  in  the  landside  data  by  the  pressure  of  queues 
which  maintain  persistent  lengths  through  busy  periods.  Data 
obtained  at  these  times  appear  to  produce  limited  fluctuation 
from  point  to  point. 

For  comparison  of  field  and  model  data  with  observations 
of  this  category  a  validation  methodology  has  been  developed 
by  Hsu  and  Hunter*  using  autoregressive  techniques.  These  authors 

i 

point  out  that  tests  using  standard  x” »  t  and  F  statistics  require 
independent  events  and  are  inapplicable.  For  their  development, 
serial  correlation  of  time  series  is  acceptable  and  forms  the 
basis  of  procedures  used.  A  set  of  autoregressive  coefficients 
are  each  determined  for  the  model  data  for  corresponding  field 
observations.  A  statistic  developed  by  the  authors  tests  a 
function  relating  ratios  of  these  coefficients  against  a  y“  dis¬ 
tribution  and  determines  validity. 

If  one  imagines  that  the  measures  of  model  validity  were  to 
be  arranged  on  a  spectrum  identifying  the  degree  to  which  they 
validate  the  amplitude  and  time  components  of  a  model,  the  mean 
value  would  fall  at  one  end  and  the  measures  of  autoregressive 

*Hsu ,  D. A.  and  J.S.  Hunter,  "Analysis  of  Simulation-Generated  Res¬ 
ponses  Using  Autoregressive  Models,"  Management  Science,  Vol.  24, 
No.  2,  Oct.  19-7. 
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structural  validity  would  be  at  the  other  end.  While  the  mean 
validates  the  absolute  magnitude  of  the  model  outputs,  it  ignores 
all  time  structure,  collapsing  all  observations  into  one. 
Autoregressive  measures,  on  the  other  hand,  ignore  the  absolute 
magnitude  of  the  outputs  and  measure  the  extent  to  which  they  are 
related  to  one  another  over  time.  For  example,  if  "c"  always 
follows  "a"  and  "b"  historically,  but  "cM  always  precedes  "a" 
and  MbM  in  the  model,  the  model  will  have  poor  autoregressive 
validity  even  though  the  mean  value  of  the  output  reproduces 
the  historical  mean  exactly. 

Autoregressive  measures  of  validity  are  most  meaningful  when 
the  process  being  modeled  is  basically  an  autoregressive  process— 
that  is  a  process  which  takes  uncorrelated  input  observations 
and  produces  output  observations  which  are  serially  or  sequential¬ 
ly  correlated.  If  the  input  stream  is  not  random,  it  becomes 
difficult  to  separate  the  autoregressive  characteristics  of  the 
process,  and  of  the  model,  from  the  autoregressive  characteristics 
of  the  inputs.  Statistically  speaking,  the  process  becomes  non- 
stationarv,  and  the  techniques  used  to  compute  autoregressive 
validity  become  inapplicable. 

Monte  Carlo  simulation  models  present  some  unique  problems 
in  estimating  confidence  intervals  and  other  statistical  measures 
of  validity  since  not  only  the  physical  system  but  also  the  model 
responds  variably  to  a  given  set  of  inputs.  Consequently,  it  is 
necessary  to  estimate  the  variation  in  outputs  of  both  the  model 
and  the  physical  system  for  a  given  set  of  inputs. 

Because  data  collection  is  expensive,  it  is  often  impractical 
to  obtain  enough  data  to  observe  the  variance  of  real-world  events. 
In  such  cases,  the  variance  of  model  outputs  must  be  examined 
to  determine  the  extent  to  which  they  are  likely  to  simu¬ 
late  realistically  the  real  world.  This  non-statist ical  valida¬ 
tion  then  becomes  the  basis  of  other  statistical  tests  such  as 
the  test  of  the  validity  of  the  mean.  This  indeed,  is  the  case 
for  the  Airport  Landside  Simulation  Model. 
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The  Airport  Landside  Simulation  Model  presents  a  problem  in 
computing  measures  of  validity  because  it  is  neither  fully  deter¬ 
ministic  nor  fully  Monte  Carlo.  Although  the  airport  facilities 
are  simulated  in  Monte  Carlo  fashion,  the  model  is  driven  by  a 
deterministic  input  stream  of  aircraft  arrivals  and  departures. 

As  shown  below,  this  precludes  the  use  of  many  of  the  schemes 
most  frequently  used  to  compute  measures  of  validity  for  simula¬ 
tion  models. 

Consider  first  the  pure  Monte  Carlo  simulation  with  one  out¬ 
put  variable.  Input  variables  are  drawn  from  pre-specified  input 
probability  distributions  and  the  output  variable,  once  the  model 
has  reached  steady-state  (and  assuming  stationarity  of  the  pro¬ 
cess),  is  also  characterized  by  a  probability  distribution.  It 
is  commonly  assumed  that  each  observation  of  the  output  variable 
is  randomly  and  independently  drawn  from  this  output  distribution. 
Based  on  this  assumption,  the  sample  mean  provides  an  unbiased 
estimate  of  the  true  output  mean,  and  the  standard  error  of  the 
estimate  of  the  mean  can  be  computed.  The  confidence  one  has  in 
the  estimate  of  the  mean  then  depends  on  the  number  of  observations 
simulated. 

Hsu  and  Hunter*  point  out  that  in  most  Monte  Carlo  simula¬ 
tions,  the  output  variable  is  not  independently  drawn  from  the 
output  distribution,  but  rather  that  the  "nth"  observation  de¬ 
pends,  to  some  degree,  on  the  preceding  "n  -  1"  observations. 

In  this  case,  the  sample  mean  will  once  again  be  unbiased;  but 
one's  confidence  in  the  estimate  of  the  mean  depends  not  only  on 
the  number  of  observations  and. their  distribution  but  also  on  the 
autoregressive  structure  of  the  model. 

The  reason  for  this  complication  is  that  in  the  case  of  in¬ 
dependent  output  observations,  the  sample  variance  is  also  un¬ 
biased.  The  variance  in  the  estimate  of  the  mean,  which  is  a 


*Hsu,  D.A.  and  J.S.  Hunter,  "Analysis  of  Simulation-Generated 
Responses  Using  Autoregressive  Models,"  Management  Science,  Vol. 
24,  No.  2,  Oct.  19"7. 


2-5 


function  of  the  variance  of  the  distribution  and  the  number  of 
samples,  is  easily  obtained.  When  the  observations  of  the  output 
variable  are  autocorrelated ,  the  sample  variance  is  a  biased 
estimate  of  the  true  variance.  If  the  outputs  are  positively 
autocorrelated,  then  their  variance  will  be  less  than  the  true 
variance  of  the  distribution,  and  vice  versa.  Once  this  bias  is 
adjusted,  the  variance  in  the  estimate  of  the  mean  can  be 
obtained . 

Xone  of  the  foregoing  discussion  is  at  all  pertinent  if  any 
of  the  input  variables  is  deterministic  and  time  varying.  It  is 
assumed  above  that  the  "nth"  observation  is  drawn  from  the  same 
distribution  as  all  other  observations,  even  though  it  may  depend 
on  the  preceding  "n  -  1"  observations.  If  the  simulation  were  to 
be  repeated  a  large  number  of  times  and  the  "nth"  observation 
were  to  be  plotted,  it  would  be  distributed  in  accordance  with 
the  output  distribution  of  the  Mn  -  1th"  or  any  other  observation. 
Thus,  although  in  any  one  run,  the  distribution  of  the  "nth" 
observation  is  affected  by  the  sample  observations  preceding  it, 
its  distribution  when  taken  across  runs  is  the  same  as  that  of 
all  other  output  observations.  It  is  this  characteristic  of  the 
Monte  Carlo  simulation  which  makes  it  possible  to  estimate  the 
variance  in  the  estimate  of  the  mean,  even  when  the  output  vari- 
ble  is  autocorrelated.  In  a  run  of  "n"  observations,  each 
observation  provides  information  about  the  mean  and  variance  of 
the  sample  from  which  it  was  drawn. 

Consider  now  the  case  of  a  Monte  Carlo  simulation  whose  in¬ 
puts  are  deterministically  time  varying.  In  this  case,  each 
observation  is  drawn  from  a  different  underlying  distribution, 
with  a  different  mean  and  variance.  As  a  result,  the  observation 
of  mean  queue  length  at  a  facility  at  the  simulated  hour  of  10:00 
a.m.,  for  example,  sheds  no  light  on  the  distribution  of  queue 
lengths  one  would  expect  at  the  same  facility  at  the  simulated 
hour  of  2:00  p.m.  Consequently,  without  several  observations 
for  each  time  period,  it  is  impossible  to  estimate  the  variance 


of  the  individual  observations  (which  in  the  case  of  a  pure 
Monte  Carlo  simulation  is  estimated  from  the  variance  of  all 
observations),  and  thus  it  is  impossible  to  estimate  the  variance 
of  the  sample  mean.  Thus,  the  traditional  t-tests  and  the  more 
sophisticated  Hsu-Hunter  technique,  each  comparing  statistics  of 
two  time  series,  are  inapplicable  to  the  time-varying-input  Monte 
Carlo  simulation. 

Hsu  and  Hunter  point  out  that  a  moving  average  (MA)  on 
combined  autoregressive  moving  average  (ARMA)  models  could  be 
obtained  for  non-stationary  data.  These  models  may  be  converted 
to  an  autoregressive  (AR)  model  if  the  fitted  residuals  of  the 
AR  model  pass  appropriate  tests  for  independence  and  normality. 

The  autoregressive  method  was  not  pursued,  because  the  non- 
stationarity  of  the  data  would  have  required,  aside  from  the 
direct  application  of  the  method,  additional  fitting  and  testing. 
Furthermore,  the  test  is  recommended  for  a  time  series  with  a 
minimum  data  length  of  60  points.  Because  the  data  obtained  at 
each  station  was  limited  to  a  maximum  of  72  observations  and 
approximately  half  of  these  points  were  dedicated  to  model 
calibration  and  the  rest  to  validation,  the  sample  sites  were 
too  small  to  take  advantage  of  this  methodology. 

The  proper  technique  for  statistically  validating  a  model 
such  as  the  Landside  Simulation  Model  is  to  run  it  several  times 
(at  least  five)  using  different  random  number  generating  seeds. 

The  estimates  of  the  "nth"  observation  in  each  run,  those  occuring 
at  each  five  minute  interval  of  simulated  time,  for  example,  can 
then  be  used  to  obtain  an  unbiased  estimate  of  both  the  mean  and 
variance  of  the  "nth"  observation. 

The  simulated  mean  and  variance  determined  at  each  time 
point  may  be  subsequently  used  to  establish  a  test  dependent 
up6n  the  number  of  occurrences  of  field  data  within  two  simulated 
standard  deviations  of  the  mean.  Assuming  a  Student  t  distribu¬ 
tion  as  the  sampling  distribution  of  the  data  produced  at  each 
time  point,  the  probability  (]-e)  of  a  point  lying  within  ^2 
standard  deviations  may  be  calculated. 
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This  probability  may  be  expressed  as: 

r Sm  (t)  dt  =  1'£  ’ 

t 

£ 

where  t  is  the  limit  of  integration  expressed  as  a  multiple  of 
the  standard  deviation  s,  and 

gm(t)  is  the  t  distribution  density  function 

The  value  of  e  may  be  obtained  from  tables  for  specified 
values  of  the  degrees  of  freedom  m.  For  the  distribution  of  data 
points  at  each  time  point,  the  number  of  degrees  of  freedom  is 
one  less  than  the  number  of  sample  points  because  the  calculation 
of  the  mean  value  has  been  performed  using  the  data. 

When  n  =4,  the  value  of  1  -  e  for  the  limits  it  *  2  is  .8"'. 
If  a  field  data  point  belongs  to  the  distribution  represented 
at  each  time  by  the  simulated  mean  and  standard  deviation,  the 
a  priori  probability  of  this  data  point  having  a  value  within  the 
standard  deviations  of  the  mean  is  87  percent.  This  value  may 
be  used  as  the  percentage  of  success  of  a  Bernoulli  trial  taken 
at  each  time  point.  Trial  confidence  limits  will  then  for  the 
range  of  acceptable  percentages  of  points  within  two  standard 
deviations  of  the  simulated  mean. 

The  null  hypothesis  is  that  the  sample  of  occurrences  of 
field  data  within  the  two  standard  deviations  of  the  simulated 
mean  has  the  same  percentage  of  successes  as  the  theoretical 
value.  This  is  tested  by  determining  the  extent  of  the  critical 
region  for  a  confidence  level  of  95  percent. 

The  expression  for  determining  the  critical  region  based 
upon  the  probability  of  success,  p,  the  probability  of  a  failure, 
q,,  and  the  number  of  time  points  n  is  the  following: 

P  - 


1.96  v pq  /n  +  l/2n  <  p  <  p 


A 


1  .  9 


96  /pq  /n  +  1  / 


2r 
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The  probability  limits  based  upon  a  sample  of  24  points  are 
calculated  by  substituting  the  values  p  =  87,  q  =  .13  and  n  =  24. 
The  limits  of  the  critical  region  for  p  are  the  following: 

.71  -  p  1  1 • 

Values  of  percentages  obtained  that  are  within  this  range 
indicate  that  there  is  no  evidence  to  contradict  the  hypothesis 
that  the  field  data  point  is  a  member  of  the  distribution 
represented  by  the  simulation  mean  and  standard  deviation  at  each 
data  point. 

The  procedure  for  performing  the  calibration  and  subsequent 
validation  of  the  Airport  Landside  Simulation  Model  consisted  of 
a  number  of  steps  to  provide  visual  and  statistical  measures  of 
assessing  performance.  These  included: 

(1)  Operating  the  model  for  the  calibration  or 
validation  time  period  using  the  geometry,  passenger, 
and  facility  service  characteristics  input  data 
applicable  to  the  airport  and  generating  the  demand 
by  using  the  flight  schedule  for  the  calibration  or 
validation  period. 

(2)  Performing  subsequent  runs  with  the  same  input  data 
but  using  altered  random  number  streams  by  changing 
the  GPSS  RMULT  values  for  each  pair  of  auxiliary  and 
main  progiam  runs. 

(3)  Producing  series  outputs  for  each  run.  Flow 
values  obtained  from  the  five  runs  were  averaged  at 
each  time  point  and  the  standard  deviation  was  also 
calculated.  The  mean  values  were  plotted  as  a  function 
of  time.  Field  data  obtained  through  observation 
during  the  corresponding  time  period  was  also  plotted 
on  the  same  pair  of  axes  for  these  facilities.  The 
time  histories  of  the  two  sets  of  data  was  visually 
compared . 
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The  simultaneous  values  of  simulated  queue  length  mean 
values  and  corresponding  field  data  value  were  also  plotted  and 
compared. 

The  calibration  time  period  input  data  was  adjusted  wnere 
possible  in  an  attempt  to  produce  better  visual  agreement,  if 
necessary,  between  field  and  simulated  values.  This  procedure 
was  repeated  for  as  many  times  as  considered  necessary.  For  the 
final  set  of  calibration  runs,  the  field  data  occurrence  within 
two  standard  deviations  was  tabulated  and  tested. 

The  validation  runs  were  performed  for  only  one  set  of 
replications.  Flow  and  queue  length  plots  were  produced  to 
provide  visual  comparisons  of  simulated  outputs  and  corresponding 
field  data.  The  percentages  of  occurrence  of  the  field  data 
within  two  standard  deviations  was  also  tested.  riots  and  results 
are  presented  in  Section  S. 


3.  VERIFICATION 


The  Airport  Landside  Simulation  Model  was  verified  for  trans¬ 
action  flow  continuity  by  examining  GPSS-V  block  counts  for 
selected  locations  at  the  conclusion  of  a  test  run.  The  numbers 
of  originating,  terminating  and  transfer  passenger  and  visitor 
transactions  generated  by  the  model  and  their  respective  routine 
functions  through  the  simulation  model  were  determined.  At  each 
module  entrance,  the  contributions  by  the  number  of  transactions 
from  each  routed  class  to  the  total  entry  count  were  determined, 
then  summed  and  the  total  was  compare  to  the  entrance  block  counts. 
Numbers  of  transactions  diverted  to  program  locations  by  input 
percentages  were  checked  for  reasonableness  based  upon  the  data 
values. 

The  resultant  of  the  verification  process  was  the  discovery 
and  correction  of  one  coding  error.  Satisfactory  model  operation 
has  been  experienced  for  transaction  generation  and  routing  since 
the  process  was  completed. 


4.  DATA  COLLECTION 


An  extensive  data  collection  program  was  conducted  in  1978 
with  the  objective  of  obtaining  data  for  ALSIM  calibration  and 
validation.  This  task  was  performed  at  Miami,  Denver,  and 
LaGuardia  Airports  during  6  continuous  hours  of  operation  for  two 
days  at  each  airport.  The  observation  times  were:  11:00  am  to 
5:00  pm  on  March  17  and  18  at  Miami;  2:00  pm  to  8:00  pm  April  13 
and  14  at  Denver;  and  2:00  to  8:00  pm  May  24  and  25  at  LaGuardia. 
The  program  was  established  to  collect  required  input  data  for 
model  calibration  at  each  airport  and  to  observe  flows,  queue 
lengths,  and  waiting  times  for  validation  by  comparison  with  model 
output.  In  order  to  assess  the  ability  of  the  model  to  represent 
the  operation  of  the  landside  as  completely  as  possible,  valida¬ 
tion  data  collection  required  the  simultaneous  observation  of  many 
essential  facilities.  The  number  of  observers  required  to  accomp¬ 
lish  this  objective  exceeded  100  per  airport.  Details  of  the 
placement  of  observers  ,  data  forms  used  and  tape  formats  produced 
are  contained  in  the  report  FAA-EM-80-2  ’’Collection  of  Calibration 
and  Validation  Data  for  an  Airport  Landside  Dynamic  Simulation 
Model”,  published  April  1980. 

From  the  calibration  data  observations,  cumulative  distribu¬ 
tions  of  service  times,  bags  per  party,  visitors  per  party  and 
other  required  input  dist ribut ions  were  produced.  The  principal 
distributions  used  to  simulate  each  airport  are  displayed  in 
Section  5. 

The  validation  data  obtained  consisted  of  flows,  queue 
lengths,  and  queue  times.  Flow  values,  the  number  of  persons  or 
vehicles  processed  by  a  facility,  were  aggregated  every  five 
minutes  for  mod^l  comparison.  Observation  of  instantaneous  queue 
length,  the  numbers  of  persons  or  vehicles  waiting  for  service  at 
a  specified  facility,  were  also  recorded  at  each  five  minute  mark. 
Stratified  samples  of  waiting  times  in  queues  were  otained  by 
observing  every  fifth  or  tenth  entity  joining  the  queue  throughout 
the  six-hour  period. 
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Flow  and  queue  length  values  were  produced  as  time  series  for 
model  comparison.  The  queue  times  at  the  observed  facilities  were 
produced  as  cumulative  distributions.  Section  5  compares  this 
data  to  model  outputs. 


5.  CALIBRATION  AND  VALIDATION 


From  the  two  days  of  data  collected  at  each  airport,  one  day 
was  selected  to  perform  model  and  field  data  comparisons.  Table 
5-1  provides  the  hourly  enplanement  and  deplanement  magnitudes  for 
each  of  the  three  airports.  With  a  few  exceptions,  as  explained 
in  the  discussion  for  Miami,  passenger  volumes  were  supplied  by 
the  airline  companies  on  a  flight-by-flight  basis  and  are  used  as 
model  input  data. 

5.1  MIAMI 

The  evaluation  of  ALSIM  was  executed  by  performing  calibra¬ 
tion  and  validation  as  two  distinct  operations,  both  involving 
model  testing.  Although  calibration  is  generally  understood  as 
the  simple  process  of  placing  site  specific  data  in  the  model 
without  performance  of  field-model  comparisons,  this  procedure 
was  altered  for  ALSIM.  In  this  case,  part  of  the  validation  data 
was  dedicated  to  an  iterative  calibration  checking  procedure.  For 
Miami,  flow  and  queue  length  data  obtained  between  1100  and  1400 
hours  was  dedicated  to  calibration  performance  testing.  Calibra¬ 
tion  data  obtained  from  field  observations  was  input  and  the  model 
operated  for  the  input  flight  schedule  times  corresponding  to  the 
calibration  time  period.  Model  outputs  are  compared  with  corre¬ 
sponding  field  data.  For  those  facilities  with  large  discrepancies 
between  field  and  simulated  data,  the  model  was  recalibrated, 
generally  by  adjusting  service  times.  ALSIM  was  rerun  for  the 
calibration  time  period  and  reevaluated.  If  substantial  visual 
agreement  was  not  obtained  additional  inputs  were  examined,  for 
example,  the  number  of  servers  might  have  changed  drastically  as 
time  progressed  with  no  corresponding  input  change.  By  reitera- 
tively  adjusting  model  inputs,  generally  good  field  and  simulation 
data  agreement  was  obtained  over  the  two  hour  period.  After  com¬ 
pleting  the  calibration  process,  the  simulation  was  operated  to 
represent  the  1400  to  1"00  validation  time  period.  No  further 
adjustments  to  model  operation  or  input  data  were  performed  for 
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TABLE  5-1.  TOTAL  HOURLY  ENPLANEMENTS  AND  DEPLANEMENTS 


Miami  -  March 

18, 

1978 

Hour. 

Enpianements 

Dep] anements 

1100-1159 

291 

1859 

1200-1259 

2899 

5894 

1300-1359 

4408 

2792 

1400-1459 

2320 

2502 

1500-1559 

1232 

1  ”80 

1600-1659 

2189 

3156 

Denver  -  April 

13, 

1978 

1400-1459 

2179 

2811 

1500-1559 

917 

1514 

1600-1659 

1732 

959 

1700-1759 

773 

1853 

1800-1859 

2638 

1117 

1900-2000 

848 

1871 

LaGuardia  -  May 

25, 

1978 

1400-1459 

1951 

1779 

1500-1559 

1696 

1275 

1600-1659 

1983 

2479 

1700-1759 

2888 

2281 

1800-1859 

2312 

2160 

1900-1959 

1986 

2433 

this  time  period.  Validation  results  are  based  entirely  upon  one 
set  of  5  model  runs  obtained  by  using  the  previously  calibrated 
input  values  applied  to  the  flight  schedule. 

The  hourly  passenger  volumes  shown  previously  in  Table  5-1 
were  obtained  primarily  from  data  supplied  by  the  airlines  pro¬ 
viding  enplanements  and  deplanement  counts  reported  on  a  per  flight 
basis.  Because  there  are  a  large  number  of  carriers  operating  at 
Miami,  it  was  practically  impossible  to  obtain  passenger  loadings 
for  all  flights  listed  in  the  Official  Airline  Guide  for  this 
data.  Several  small  volume  carriers  with  one  or  two  flights  daily 
were  unable  to  respond  to  the  survey.  As  a  result,  approximately 
19  flights  of  the  204  used  for  the  calibration  period  were  inserted 
into  the  flight  schedule  by  using  OAG  listings.  Airline  numbers, 
aircraft  type,  arrival  and  departure  times  were  taken  directly 
from  this  source.  The  numbers  of  passengers  were  derived  by  using 
nominal  values  from  OAG  aircraft  type  information.  These  were 
modified  by  load  factors  occurring  on  this  day  for  reported  flights 
with  identical  or  similar  destinations.  If  the  carrier  did 
respond,  flights  missing  from  the  OAG  list  were  assumed  to  be 
cancelled.  Validation  time  period  flights  were  treated  in  an 
ident ica 1  manner . 

Distributions  used  to  simulate  Miami  International  Airport 
are  shown  in  Table  5-2.  Selected  distributions  from  this  list 
are  shown  in  succeeding  Tables. 

The  model  was  calibrated  and  validated  by  comparing  model 
output  and  corresponding  field  data  at  each  time  point.  Fourteen 
facilities  at  Miami  International  Airport  were  chosen  for  model 
performance  evaluation.  These  were: 

1.  Security  Stations  at  Concourses  B  through  H. 

2.  Eastern  Airlines  Full  Service  Ticket  Counter. 

3.  Eastern  Airlines  Express  Check-in  Counter. 

4.  Southern  and  Trans  World  Airlines. 

Ful-1  Service  Counters. 


TABLE  5-2.  LIST  OF  DISTRIBUTIONS 

Arrival  Time  Prior  to  Flight 
Originating  Pax/Party 
Well  Wishers/Party  (Enplaning) 
Baggage  Unloading  Time 
Express  Check-In  Time 
Gate  Process  Time 
Ticket  Check-In  Time 
Security  Station  Processing  Time 
Immigration  Process  Time 
Customs  Process  Time 
Parking  Lot  Exit  Service  Time 
Car  Rental  Process  Time 
Curbside  Check-In  Time 
Vehicle  Unloading  Time 
Pax/Party  Deplaning 
Greeters /Party  (Deplaning) 
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TABLE  5-3.  ARRIVAL  TIME  PRIOR  TO  FLIGHT  (ORIGINATING  PASS.) 


Comulative  Percent 
Arriving 


Time  to  Flight  Departures 
(Minutes) 


0  150 

11.5  95 

38  64 

68  44 

90  26 

100  10 


TABLE  5-4.  PASSENGERS  PER  PARTY  (EXCLUDING  TRANSFERS) 


Cumulative  Percent 


Passengers 


39  1 

73  2 

65  3 

93  4 

96  5 

100  6 
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TABLE  5-5.  WELL-WISHERS  PER  PARTY 


Comulative  Percentage 

74 

90 

97 

98 

99 
100 


Number  of  Well-Wishers 

0 

1 

2 

3 

4 

5 


TABLE  5-6.  GREETERS  PER  PARTY 


Cumulative  Percentage 

57 

77 

92 

96 

98 

99 
100 


Number  of  Greeters 

0 

1 

2 

3 

4 

5 
8 
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TABLE  5-7.  EXPRESS  CHECK-IN  TIME 


Comulative  Percent 
0 

5.1 

16.9 

68.0 

87.0 

95.6 

100 


Time  (Minutes) 

0 

1 

2 

5 

7 

9 

15 


TABLE  5-8.  TICKETING  CHECK-IN  TIME  (EASTERN) 


Comulative  Percent 


Time  (Minutes) 


0 

10 

20 

57.9 

67.2 

80 

89 

98.4 

100 


0 

2 

2. 

4 

4. 

5. 
7. 


10. 

14.5 
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TABLE  5-9.  SECURITY  STATION  PROCESSING  TIMES 


Concourse 

B 

Concourses  C, 

F,  G,  H 

Cumulative 

Percent 

T  ime 

(Seconds) 

Cumulative 

Percent 

Time 

(Seconds) 

50 

3 

20 

4 

75 

4 

45 

5 

91 

5 

80 

6 

97 

10 

95 

/ 

99 

20 

99 

10 

100 

30 

100 

30 

Concourse 

D 

Concourse 

E 

Cumulative 

Percent 

Time 

(Seconds ) 

Cumulative 

Percent 

Time 

(Seconds) 

25 

5 

40 

4 

60 

6 

78 

5 

85 

7 

95 

6 

95 

8 

98 

10 

99 

10 

99 

20 

100 

30 

100 

50 
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TABLE  5-10.  IMMIGRATION  PROCESSING  SERVICE  TIMES 


rT 


Cumulative  Percent  Time  (Minutes) 


0 

0 

8.5 

1.0 

31.5 

1.67 

61.2 

2.33 

77.8 

2.83 

90.1 

3.5 

95.2 

6.0 

99.1 

5.0 

100.0 

6.5 

TABLE  5-11.  CUSTOMS  INSPECTION  SERVICE  TIMES 


Cumulative  Percent  Time 

0  0 

7.5  0.5 

46.1  1.25 

74.0  2.0 

86.2  2.5 

94.1  3.5 

100  6.8 
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TABLE  5-12.  PARKING  FACILITY  EXIT  SERVICE  TIMES 


Cumulative  Percent 


Time  (Minutes) 


0 

8.8 

26.2 

50.4 
71.9 
84.7 
94.2 

98.5 
100 


0 

0.5 
0.75 
1.0 
1 .  25 
1  .  5 
2.0 
2.5 
3.75 


5.  Immigration. 

6.  Customs. 

7.  Visitors  Parking  Facility  #1. 

8.  Parking  Facilities  4  and  5  Combined. 

Although  the  simulation  model  represents  other  facilities  and 
comparison  data  was  obtained,  the  above  were  chosen  because  they 
provided  the  best  opportunity  for  observation  of  flow  and  queue 
length.  Exceptions  occurred  at  customs  and  immigration.  Demand 
was  so  large  at  customs  that  the  observer  was  unable  to  record 
flow  and  queue  length  simultaneously,  and  thus  recorded  only  flow. 

At  immigration,  queue  lengths  extended  into  the  hallway  leading 
to  the  facility  room  and  were  unobservable.  Again,  only  flow 
values  were  recorded. 

The  calibration  period  was  selected  to  extend  from  1115  to 
1400  hours.  For  this  interval,  mean  values  and  standard  devia- 
t.ons  of  simulation  outputs  from  5  runs  were  obtained  for  each 
time  point.  Differences  in  output  value  were  obtained  by  altering 
random  number  streams  in  successive  runs. 

Several  reiterations  of  the  calibration  process  and  update 
of  input  data  were  necessary  to  provide  reasonable  agreement 
between  field  and  simulated  values.  The  necessity  of  adding 
flights  obtained  from  the  OAG  to  the  data  supplied  by  the  airlines 
has  been  discussed.  At  security  the  service  times  obtained  by 
direct  observation  were  significantly  longer  than  those  providing 
flow  rates  observed  occurring  under  queueing  conditions.  A  con¬ 
stant  8  second  service  time  was  initially  used  as  an  estimate 
but  did  not  replicate  the  observed  queueing.  The  flow  rates 
observed  occurring  under  queueing  conditions  during  the  calibra¬ 
tion  period  were  then  used  to  produce  the  processing  times  exhibi¬ 
ted  in  Table  5-9. 

Other  service  times  obtained  from  the  field  observations  also 
required  modification  to  permit  scaled  operation  of  the  model.  The 
scaling  feature  permits  the  representation  of  an  input  number,  n,  of 
passenger  groups  by  a  single  CIPSS  transaction.  The  model  was 
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initially  operated  by  multiplying  the  randomly  generated  service 
time  at  a  processing  facility  bv  the  scale  factor  to  produce  the 
service  time  for  the  n  passenger  groups.  This  produced  flow 
values  at  the  facility  that  exhibited  wider  variations  in  flow 
than  expected.  This  selection  of  service  times  appeared  to  choke 
the  facility  outflow  and  then  produce  a  flood  of  simulated  passen¬ 
gers  or  vehicles  in  a  subsequent  time  interval.  This  behavior  was 
corrected  by  performing  an  n-1  fold  convolution  of  the  service 
time  frequency  distribution  for  the  facility.  The  resulting 
service  time  produced  from  this  convolution  was  not  multiplied  by 
the  scale  factor,  however,  but  was  used  directly  because  the  new 
distribution  represented  the  probability  of  the  n  passenger  groups 
drawing  a  given  service  time  value.  Probabilities  of  long  service 
times  became  extremely  small  when  the  procedure  was  used.  Flow' 
values  produced  were  in  better  agreement  with  corresponding  field 
data  than  previous  values. 

The  effects  of  these  changes  were  examined  by  plotting  the 
model  output  and  field  data  on  the  same  set  of  axes  for  each 
facility.  The  first  set  of  calibration  runs  and  the  validation 
outputs  are  shown  in  this  report. 

Results  are  presented  in  plotted  and  tabular  forms.  Five- 
minute  cumulative  flows  versus  time  and  point  values  of  queue 
length  recorded  every  five  minutes  versus  time  are  plotted  for 
visual  comparison.  Simulated  and  field  values  appear  on  the  same 
set  of  axes.  Observed  values  obtained  during  the  data  collection 
period  are  connected  by  solid  lines  and  simulated  output  by  dashes. 
The  data  exist  at  the  five-minute  interval  points  only,  and  plots 
should  not  be  interpolated. 

All  field  and  simulated  plotted  data  were  smoothed  by  3  point 
weighting.  Interior  point  weights  were  0.28,  0.44,  and  0.28, 

SI\  -tt  Y 

obtained  from  the  function  — '  -  .  End  points  were  smoothed  by  a 
polvnominal  fit  obtained  from  the  IBM  SSP  subroutine  SE13. 

Smoothing  was  performed  to  provide  a  better  visual  presentation 
by  modifying  extreme  and  rapid  excursions  in  magnitude.  On  each 
calibration  plot,  .  set  of  numbers  appears  in  parentheses.  These 
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are  the  assigned  field  observer  numbers  described  in  the  document 
FAA-EM-80-2. 

Following  each  graphical  presentation  is  a  Table  displaying 
the  simulation  flow  output  as  a  function  of  time.  Outputs  of  five 
runs  and  their  calculated  average  and  standard  deviation  are  pre¬ 
sented  for  each  time  point.  A  second  table  presents  the  field 
data  observed  at  each  time  point,  the  flow  values  at  the  simulated 
*  mean  minus  and  plus  one  simulated  standard  deviation  and  a  column 

signifying  if  the  field  observation  was  within  one  standard  devia¬ 
tion  from  the  simulation  mean.  A  1  zero’  or  a  ’one’  in  the  OK 
column  respectively  indicate  if  the  field  value  lies  outside  or 
inside  the  one-standard  deviation  limit.  The  same  format  is  used 
for  two  simulated  standard  deviations. 

Results  for  Concourse  B  are  included  in  the  following  section. 
The  comparison  plots  and  tables  for  remaining  Miami  facilities  are 
shown  in  Appendix  A  of  this  volume. 

Only  plots  were  generated  for  queue  length  comparisons. 

Visual  agreement  was  not  generally  good  enough  to  warrant  further 
testing.  The  queue  length  plots  are  presented  and  discussed. 

5.1.1  Concourse  B 
CALIBRATION 

Plots  of  field  data  and  corresponding  simulation  output  for 
flow  and  queue  length  during  the  calibration  period  of  1115  to 
1400  hours  are  exhibited  in  Figures  5-1  and  5-2.  The  simulation 
generally  remains  in  phase  with  field  data,  however  the  magnitude 
of  model  output  is  smaller  for  both  parameters  simultaneously. 
Simulated  flow  values,  computed  average  and  standard  deviation  at 
each  time  point  are  exhibited  in  Table  5-15.  This  example  illus¬ 
trates  the  time  varying  nature  of  both  the  mean  and  standard 
deviation.  Table  5-14  displays  lower  and  upper  limits  of  a  band 
of  values  centered  at  the  simulation  mean  and  extending  one 
standard  deviation  above  and  below  the  m.-an.  An  indicator  in  the 
’OK?’  column  indicates  if  the  field  value  lies  outside  (0)  or 
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FIGURE  5  -  2 .  MIAMI  CONCOURSE  B  SECURITY  STATION  QUEUE  LENGTH- 


inside  (1)  this  band.  The  same  display  is  repeated  for  two 
standard  deviations. 


In  this  example,  actual  results  are  41  and  71  percent  for 
inclusion  within  the  one-and  two-standard  deviation  limits,  respec¬ 
tively.  The  model  does  not  represent  the  facility  perfectly,  but 
does  so  for  a  substantial  part  of  the  calibration  period.  In 
general,  the  simulation  requires  increased  demand,  especially  at 
the  1300  peak.  This  need  is  supported  by  the  queue  length  curve. 

VALIDATION 

The  validation  plots  are  exhibited  as  Figures  5-3  and  5-4; 
Tables  5-15  and  5-16  contain  the  corresponding  tabulated  data. 
Although  the  trends  of  the  flow  plot  from  1400  to  1525  hours 
appear  close,  the  tabulated  agreement  is  not  good  during  this  time 
period.  Again,  the  demand  is  insufficient  during  this  time  period. 
Only  33  percent  of  the  field  flow  values  are  within  one-standard 
deviation  and  67  percent  are  inside  the  two-standard  deviation 
band.  The  results  are  consistent  with  calibrated  levels. 

5.1.2  Concourse  C 
CALIBRATION 

The  model  clearly  exhibits  phase  error  in  representing  this 
facility  as  illustrated  in  Figure  A-l.  Queue  length  representation 
is  virtually  non-existent  as  displayed  by  Figure  A-2.  The  numeri¬ 
cal  results  (Tables  A-l  and  A-2)  indicate  that  this  field  data 
was  within  la  only  28  percent  of  the  time  and  64  percent  of  the 
data  points  were  within  two  standard  deviations. 

VALIDATION 

Because  of  a  data  tape  formatting  error,  validation  plots  are 
not  available  for  this  facility.  The  validation  flow  percentages 
are  better  than  those  obtained  during  the  calibration  (Tables  A-3 
and  A-4).  These  are:  41  percent  within  one  standard  deviation 
and  79  percent  within  two  standard  deviations.  Mean  simulated 
flows  are  generally  less  th  the  field  values  indicating  modeled 
demand  was  too  low. 
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TABLE  5-15.  CONCOURSE  B  FLOW:  VALIDATION 


m  r  r 

DAr  1 

-  D 

7  7  6  1 

7*!  SO?!  7*7 

5 

A7G 

14 

35 

4 

10 

15 

12 

3 

10.00 

4 . 47 

14 

10 

10 

24 

12 

14 

15 

15.20 

5.40 

1  4 

15 

3 

4 

4 

6 

4 

3,60 

2.19 

14 

20 

s 

2 

6 

4 

4 

4.40 

1.67 

14 

2  5 

5 

3 

8 

2 

0 

4.30 

3 .63 

14 

3  0 

12 

20 

2 

26 

12 

14.40 

9.10 

14 

35 

4 

2 

3 

14 

4 

3.40 

4.77 

14 

4  0 

14 

12 

3 

20 

22 

15.20 

5.76 

14 

45 

12 

6 

2 

4 

12 

7.20 

4.60 

1  4 

50 

1  8 

13 

26 

12 

6 

1  G  .  0  0 

7 . 4  S 

14 

55 

18 

1  3 

2  6 

23 

15 

21.20 

5 .40 

1  5 

3  0 

n 

26 

14 

2 

26 

15.60 

10.43 

1  5 

0  5 

30 

32 

53 

1  2 

22 

30.30 

17.12 

1  5 

10 

36 

10 

30 

34 

38 

29.60 

11.35 

1  5 

1  5 

36 

42 

26 

34 

36 

34.30 

5.7  5 

15 

20 

3  6 

32 

24 

1  3 

16 

25.20 

8.57 

1  5 

25 

8  6 

5  3 

20 

63 

50 

56.40 

24.30 

1  5 

30 

36 

5  5 

4  3 

5  4 

34 

4  7.60 

13.22 

1  5 

35 

64 

4  6 

76 

4  3 

4  0 

5  4.30 

14,31 

15 

4  0 

34 

1  3 

50 

3  3 

74 

42  .  30 

2  0.35 

1  5 

45 

56 

40 

32 

40 

28 

3  0.20 

10.73 

1  5 

53 

24 

5  4 

5  4 

43 

70 

52.00 

17.93 

15 

55 

3  8 

4  4 

2  0 

72 

43 

4  4.40 

13.76 

16 

0  0 

24 

4  4 

34 

20 

53 

3  5.00 

15.43 
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TABLE  5-16.  CONCOURSE  B  FLOW:  VALIDATION 


A  1 

1  9  T  '  /  7 

i  *’  r>  p 

2  ff- o 

A  '1  -*  -%  f  "■>  r> 

")  r  /  . 

■  .  - 

;  .17  i 

r  ^  • 

*;r  7-; 

3  vo 

r  ^  7/ 

7?/ 

— 

--- 

)  s 

7 

5*57 

14.47 

1 

1.93 

15.94 

1 

1  9 

9 

7  ;  *, 

7  ^  .  nl 

9 

4  .  0  0 

2  5.91 

9 

1  J 

T 

1.41 

5.74 

9 

3.7^ 

7.3  5 

1 

4 

2.77 

5.97 

1 

1  .  9  5 

7.75 

1 

p  'j 

4 

1.77 

3.4} 

1 

“2  .  47 

12.97 

1 

1  -5 

5.37 

2  5.57 

1 

3.5) 

3  2.59 

1 

3  5 

1 

1.55 

11.17 

r\ 

"3  .  15 

15.95 

9 

; 

1  7 

0.44 

2  5.35 

1 

3 . 5 

2  5.72 

i 

JL 

4  5 

2  4 

2  •  5  3 

1 1 .  n 

3 

“2.01 

15.41 

J 

5 : 

2  3 

3.52 

2  3.44 

J 

1.03 

3  0.07 

1 

3  .> 

15.7  7 

2  5. 5  7 

9 

17.33 

3  2.91 

9 

i  ) 

1  ' 

3.17 

2  5.93 

1 

5.25 

5  5.43 

1 

j  b 

3  f • 

13.55 

9  7.32 

1 

“3  .45 

5  5.95 

1 

1  9 

53 

14.25 

4  7.35 

) 

5.03 

5  2.39 

«.y 

1  5 

5  5 

2  9.  )  4 

4  9.5  5 

-\ 

2  3.25 

5.32 

9 

2  J 

3  4 

1  5  .  S3 

3  9.  7  7 

7.45 

4  2.5  4 

1 

2  5 

5  5 

3  2.31 

n .  7  5 

1 

7.02 

105.1? 

1 

3  :» 

j  4 

3  4  .  5  J 

5  3.72 

9 

21.15 

7-4.3  4 

1 

1  s 

o  : 

3  5.3  3 

5  4.51 

4 

2  5,10 

7  4.41 

0 

4  1 

7  4 

:  i  o ; 

^  J  •  '  ' 

3 

1.09 

<4.5? 

i 

4  5 

'  5 

2  7.47 

4  5 . 9  3 

3 

17.73 

9  9.37 

- 

5  9 

S2 

3  4.17 

3  0.  75 

J 

15.5  3 

5  7.57 

1 

s  s 

7  i 

2  5.52 

53  .  1  ' 

9 

5  .  ?.  .9 

71.97 

X 

1 ~ 

4  7 

7  9.57 

51.4  3 

1 

5.15 

•5  5.  7  5 

1 

5.1.5  Concourse  D 


The  model  represents  the  phase  of  flow  changes  adequately. 
Demand  is  underestimated  at  peaks  as  demonstrated  consistently  by 
the  combination  are  the  flow  and  queue  length  plots  (Figures  A-3 
and  A-4).  Both  quantities  are  simultaneously  underrepresented  by 
the  model.  Numerical  results  (Tables  A-5  and  A-6)  indicate  53 
percent  of  the  points  within  one  standard  deviation  and  82  percent 
within  two  standard  deviations. 

VALIDATION 

With  the  exception  of  prediction  of  the  model  peak  at  1625, 
some  30  minutes  ahead  of  the  corresponding  field  peak,  the  model 
provided  generally  good  representation  of  this  facility.  The 
peaking  of  flow  and  queue  length  (Figures  A-5  and  A-6)  are  con¬ 
sistent  in  the  time  difference  because  the  simulation  generally 
remained  in  phase  with  field  data  during  calibration,  the  probable 
reason  for  the  discrepancy  is  a  group  of  flights  near  this  time 
which  should  be  displaced  in  the  input  schedule.  Between  1405  and 
1600  hours,  58  percent  of  the  field  flow  was  within  one  standard 
deviation  of  the  simulation  mean  and  96  percent  within  two  standard 
deviations.  (Tables  A-~  and  A-8). 

5.1.4  Concourse  E 

Throughout  most  of  the  calibration  period  the  demand  and  ser¬ 
vice  rates  matched  the  field  conditions.  Both  queue  length  and 
flow  remain  close  to  observed  data.  Phase  and  magnitude  are 
closely  followed  Figures  A-7  and  A-8.  Approximately  42  percent 
of  the  field  values  are  within  one  standard  deviation  of  the  simul¬ 
ated  mean  and  88  percent  of  the  field  values  are  within  two 
standard  deviations  (Tables  A-9  and  A-10). 

Validation  model  results  during  the  validation  period  were 
degraded  slightly  from  those  obtained  during  calibration.  The 
flow  peak  at  the  beginning  of  the  period  was  well  matched.  The 
model  does  not  match  the  phase  of  field  changes  after  1420  but  the 
trends  are  generally  compatible.  The  large  queue  length  at  the 


beginning  of  the  validation  period  is  matched  approximately  30 
minutes  later  by  the  model.  The  later  queue  length  peak,  at  1615, 
is  not  represented  by  the  model.  During  the  validation  period, 
the  modeled  demand  appears  to  lag  the  field  measurement  by  approx¬ 
imately  45  minutes  suggesting  that  the  passengers  spend  more  time 
at  a  prior  facility.  No  evidence  of  this  was  exhibited,  however, 
during  the  calibration  period.  (Figures  A-9  and  A -  1 0 . ) 

The  flow  tabulations  (Tables  A-ll  and  A-12)  indicate  that  50 
percent  of  the  field  points  are  inside  the  one-standard  deviation 
band  and  "5  percent  are  within  two  standard  deviations. 

5.1.5  Concourse  F 

Initial  conditions  are  responsible  for  the  model  missing  the 
peak  in  flow  and  queue  length  at  1115.  Otherwise  this  simulation 
provided  good  agreement  with  observed  data  (Figures  A-ll  and  A-12). 
Fifty  percent  of  the  field  points  were  within  one  standard  devia¬ 
tion  of  the  simulation  mean.  At  two  standard  deviations,  the 
value  is  "0  percent  (Tables  A-13  and  A-14). 

VALIDATION 

The  model  operated  correctly  from  1405  to  1600  hours  (Figures 
A-13  and  A-14).  At  1600,  the  input  number  of  servers  should  have 
been  increased  from  one  to  two.  This  change  was  noted  in  the  field 
data,  but  not  placed  in  the  model.  The  simulated  flow  would  have 
increased  and  the  corresponding  queue  length  at  this  time  would 
be  much  closer  to  the  field  value.  However,  during  the  earlier 
period  42  percent  of  the  field  values  are  within  one  and  rS  percent 
within  deviations  two  standard  deviations  (Tables  A- 15  and  A- 16). 

5.1.6  Concourse  C 

The  simulation  provided  close  agreement  in  flow,  especially 
at  the  1300-hour  peak.  Corresponding  queue  length  at  this  time 
shows  an  extreme  fluctuation  by  the  model.  This  fluctuation  in 
queue  length  corresponds  to  a  period  of  substantial  activity  at 
the  processor.  The  field  observer  was  unable  to  enter  the  queue 
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length  size  at  1350  and  1340.  Due  to  the  large  volume  of  flow 
counts  it  may  have  been  impossible  to  simultaneously  observe  queue 
length  and  flow.  The  data  taken  at  this  station  on  the  previous 
day  exhibits  a  large  surge  in  queue  length,  increasing  from  approx¬ 
imately  5  persons  at  1320  to  50  persons  at  1530.  The  next  two 
time  blocks  are  again  blank,  indicating  a  possible  difficulty  in 
recording  flow  and  queue  length  simultaneously.  The  flow  from 
this  previous  day  was  similar  to  the  one  exhibited  here,  and 
exhibited  a  peak  of  92  person  during  the  1340  to  1545  interval. 

The  conclusion  is  that  the  queue  length  expansion  at  this  period 
is  real  but  is  simulated  slightly  early  (Figures  A-15  and  A - 1 6 ) . 
Field  flow  data  points  within  one  standard  deviation  were  70 
percent  and  82  percent  were  within  two  standard  deviations  of  the 
simulated  mean  (Tables  A-17  and  A-18). 

VALIDATION’ 

After  providing  excellent  agreement  during  the  calibration 
period,  especially  at  peak  periods,  the  model  performed  poorly 
during  a  validation  peak  period  (Figures  A-17  and  A-18).  The  off- 
peak  flow  agreement  is  generally  good  but  poor  results  are  obtained 
for  queue  length  representation  at  this  time.  The  lack  of  agree¬ 
ment  at  peak  period  is  obviously  due  to  under-represented  demand, 
but  the  queue  length  peaks  at  1450,  1610  and  1645,  can  not  be 
readily  explained. 

An  unusually  high  (62)  percent  of  field  data  points  were  with¬ 
in  one  standard  deviation  of  the  simulated  mean.  At  two  standard 
deviations  the  value  is  75  percent  (Tables  A-19  and  A-20). 

5.1.7  Concourse  H 

The  model  output  is  largely  at  variance  with  field  observa¬ 
tions  (Figures  A-19  and  A-20).  Hourly  enplaning  passenger  counts 
furnished  by  airlines  using  this  concourse  were:  0  passengers 
from  1100  to  1200,  290  passengers  from  1200  to  1300,  1122  passen¬ 
gers  from  1300  to  1400  and  230  passengers  from  1400  passengers  to 
1500.  The  simulated  flight  schedule  reflects  these  totals.  The 
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OAG  schedule  shows  no  flights  scheduled  by  airlines  on  the  con¬ 
course  from  1100  to  1200  and  is  consistent  with  airline  informa¬ 
tion. 

Simulation  output  indicates  saturation  of  the  facility  from 
1215  to  1345  hours  but  this  is  not  supported  by  field  data  (Tables 
A-21  and  A-22).  The  simulation  results  are  consistent  with  the 
input  data,  but  the  nature  of  the  discrepancy  is  unclear. 

VALIDATION 

The  simulation  model  provided  generally  better  agreement 
during  this  period  than  was  observed  for  calibration.  Flow  and 
queue  length  are  consistent  and  indicate  that  the  demand  should 
be  increased  between  1630  and  1700  (Figures  A-21  and  A-22). 

Tabular  data  indicate  a  54  percent  occurence  of  the  field 
data  within  one  standard  deviation  of  the  simulated  during  the 
period  1405  to  1600  hours.  The  twro-standard-deviation  value  during 
this  time  period  is  100  percent  (Tables  A-23  and  A-24). 

5.1.8  Parking  Facilities 

The  exits  of  parking  facilities  1,  4,  and  5  were  simulated. 
Parking  garage  number  1  is  for  visitor  use  and  has  exits  on 
enplaning  and  deplaning  levels.  Enplaning  simulated  passengers 
with  visitors  proceeding  directly  to  parking  are  assigned  to  this 
facility.  Simulated  greeters  using  a  parking  facility  who  then 
proceed  to  the  curb.ide  for  passenger  and  baggage  pickup  after 
meeting  inside  the  terminal  are  also  assigned  to  the  parking  facil¬ 
ity  number  1.  A  percentage  of  vehicles  forced  to  recirculate  by 
curbside  enforcement  are  also  assigned  to  this  facility.  The 
percentage  is  an  input  parameter. 

Parking  facilities  four  and  five  were  utilized  by  simulated 
deplaning  passengers  using  private  auto  without  greeters  and  those 
with  greeters  whose  use  excludes  the  curbside.  Because  these 
facilities  are  on  opposite  sides  of  a  central  roadway,  a  simula¬ 
tion  strategy  was  attempted  which  models  passenger  parties  utiliz¬ 
ing  airlines  on  the  northern  half  of  the  terminal  building,  includ¬ 
ing  Eastern,  Braniff,  Pan  American  and  all  other  international 
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carriers  using  concourse  E,  as  users  of  facility  five.  The  others 
were  assigned  to  facility  four.  This  strategy  proved  unsuccessful 
when  field  and  simulated  flows  were  compared. 

A  further  strategy  was  attempted  to  perform  assignments  to 
these  facilities  based  upon  the  rate  of  cumulative  outflow  counts 
observed  at  each  of  the  two  facilities  during  the  calibration 
period.  The  assignment  split  was  80  percent  for  facility  five  and 
the  remainder  for  facility  four.  Comparing  the  two  exits  sepa¬ 
rately  did  not  produce  good  visual  agreement  and  the  outflow  of 
the  two  was  combined  for  comparison  purposes,  although  they  are 
simulated  individually. 

Examining  the  plot  (Figure  A-23)  and  numerical  comparison 
(Tables  A-25  and  A- 2 6 )  for  parking  facility  number  one,  it  is  seen 
that  the  model  outflow  does  not  provide  a  good  match  with  the  field 
data.  The  model  assumptions  assigning  transactions  to  this  facil¬ 
ity  are  questionable.  The  percentages  of  points  within  one  and 
two  standard  deviations  are  a  correspondingly  low,  20  and  48  percent 
respectively.  No  field  queue  data  was  available  for  this  facility. 

For  parking  facilities  four  and  five,  the  simulation  model  as 
shown  in  Figure  A-24  produced  substantially  good  flow  agreement. 

The  phase  of  the  model  output  generally  agreed  with  field  data. 

The  major  peak  at  1325  was  missed  by  the  model,  however. 

Numerical  flow  comparisons  show  36  percent  of  the  data  points 
between  1145  and  1400  within  one  standard  deviation  (Tables  A-27 
and  A-28).  Over  the  same  time  period,  85  percent  of  the  field 
points  were  within  two  standard  deviations  of  the  simulated  mean. 

The  queue  length  plot  (Figure  A-25)  produced  during  the  same 
time  period  indicates  that  the  simulation  predicts  the  onset  of 
substantial  congestion  correctly  but  does  not  provide  accurate 
information  describing  the  duration  of  the  effect. 

VALIDATION 

The  simulated  discharge  of  vehicles  from  parking  facility  1 
(Figure  A-26)  exceeds  the  observed  flow  through  almost  all  of  the 
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validation  period.  Modeled  rates  from  1405  to  1625  were  approxi¬ 
mately  30  percent  higher  than  the  field  data  indicates.  The 
period  following  1625  shows  no  agreement  between  the  two  data 
sets.  Tabulated  flow  values  (Tables  A-29  and  A-30)  from  1405  to 
1600  show  only  17  percent  within  one  standard  deviation  and  42 
percent  within  two  standard  deviations  of  the  simulation  mean. 

These  numbers  are  consistent  with  calibration  flow  and  indicate 
failure  of  the  model  to  correctly  specify  either  demand  or  service 
parameters  for  this  facility. 

Parking  facilities  4  and  5  exhibited  good  flow  modeling 
although  the  simulated  average  rate  was  nearly  20  percent  belour 
the  flow  average  (Figure  A -  2  7 ) .  Modeled  queue  length  did  not  com¬ 
pare  favorably  with  field  data  (Figure  A-28).  The  initial  obser¬ 
ved  queue  length  which  arose  from  the  earlier  calibration  period 
was  not  present  in  the  model.  The  modeled  demand  throughout  the 
validation  period  and  in  the  later  part  of  the  calibration  period 
was  inadequate . 

During  the  validation  period  58  percent  of  the  parking  faci¬ 
lity  4  and  5  measured  flow  was  within  one  standard  deviation  of 
the  simulated  mean  and  85  percent  of  the  field  data  points  were 
within  two  standard  deviation  (Tables  A-31  and  A-52). 

5.1.9  Ticket  Counter 

Three  facilities  were  compared:  Eastern  Airlines  full-service 
and  express  counters  and  Southern  and  TH'A  full-service  counters. 

The  last  two  are  separate  facilities  but  were  combined  into  a 
single  observation.  There  are  no  plots  for  this  data. 

At  the  Eastern  full-service  ticketing  counter  the  simulation 
flow  results  for  the  calibration  period  exceeded  the  field  data  by 
a  large  margin  (Figure  A-291  modeled  queue  length  was  nonexistant 
(Figure  A-30.  During  this  time  two  observers  were  maintaining 
counts  of  flow  and  queue  length.  The  observer  for  counters  1  through 
7  reported  consistently  higher  flow  counts  than  those  processed  by 
counters  8  through  14.  In  each  instance,  the  number  of  servers  was 
generally  equal.  If  the  first  observer  counts  are  doubled,  flow 
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rates  are  closer  to  simulation  results.  The  discrepancy  may  be  due 
to  the  observer  recording  numbers  of  parties  instead  of  persons  or 
the  possibility  of  a  different  type  of  service  at  the  higher  number 
of  counters.  The  model  uses  the  same  service  time  distribution  for 
all  of  the  Eastern  full-service  counters.  Only  29  percent  of  the 
field  data  flow  counts  were  within  one  standard  deviation  and  73 
percent  were  within  two  standard  deviations  of  the  simulation  mean 
(Tables  A-33  and  A-34). 

The  simulation  also  produces  excessive  flow  counts  for  the 
combined  Southern  and  TWA  counters  (Tables  A-35  and  A-36).  Because 
a  large  variance  in  counts  is  produced  by  the  model  for  these 
facilities,  59  percent  of  the  flow  counts  are  within  one  standard 
deviation  and  76  percent  within  two  standard  deviations. 

The  Eastern  express  check-in  counter  flow  is  consistent  with 
the  two  previous  facilities.  Simulated  flow  counts  (Figure  A-31) 
exceeded  field  values  by  a  noticeable  difference.  Again,  modeled 
queue  lengths  were  zero  (Figure  32).  As  in  the  Southern/TWA  ex¬ 
ample  the  simulated  flow  variance  is  large  enough  to  allow  a  sub¬ 
stantial  percentage  of  the  data  points  to  be  within  two  standard 
deviations  (Tables  A-37  and  A-38).  For  one  standard  deviation  this 
value  is  44  percent  and  88  percent  for  two. 

The  queue  length  plots  of  Eastern  facilities  indicate  that 
the  model  is  operating  with  incorrect  initial  conditions.  Slower 
simulated  processing  rates  may  contribute  to  increasing  modeled 
queue  lengths.  However,  this  change  alone  will  neither  provide 
the  large  queue  at  1115  nor  match  this  downward  trend  of  observed 
queue  lengths  throughout  the  calibration  period. 

VALIDATION 

Field  and  model  data  show  wide  discrepencies  in  flow  and  queue 
length  at  the  Eastern  Airlines  full  service  ticket  counter  (Figures 
A-33,  A-34).  The  processing  rate  at  this  facility  is  too  large. 
Although  observed  flow  counts  may  be  unaccountably  low,  as  in  the 
calibration  interval,  the  growth  of  the  queue  observed  at  1430  to 
1530  matches  the  increased  flow  during  this  period.  A  decreased 
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service  rate  would  undoubtedly  provide  better  agreement  for  both 
flow  and  queue  length  plots.  The  one-  and  two-standard  deviation 
inclusion  for  flow  are  29  and  58  percent  respectively.  (Tables 
A- 59  and  A- 40) . 

The  Eastern  Airlines  express  counter  produces  good  agreement 
for  flow  counts,  but  the  model  performs  poorly  as  an  indicator  of 
queue  length.  (Figures  A-35  and  A-56.)  Again,  as  in  the  calibra¬ 
tion  period,  initial  conditions  are  not  properly  introduced  in  the 
model.  The  initial  queue  at  1405  is  non-existent  in  the  model. 

The  arrival  and  service  rates  at  the  facility  appear  nearly  correct 
when  the  profiles  from  1445  to  1655  are  compared.  The  model 
exhibits  a  slightly  higher  capacity  than  the  field  operation  at 
the  1550  and  1655  peaks.  The  slight  queue  increases  in  the  field 
data  may  be  attributed  to  the  demand  reaching  facility  capacity  at 
these  times. 

Numerical  results  for  express  check-in  flow  (Tables  A-41  and 
A -  4  2)  between  1405  and  1600  indicate  75  percent  of  the  field 
points  are  within  one  standard  deviation  of  the  simulated  mean 
and  nearly  88  percent  within  two  standard  deviations. 

Southern  and  TWA  flow  during  the  validation  period  was  unfor¬ 
tunately  at  a  low  level.  The  agreement  between  the  simulation  and 
field  data  is  poor  and  considerably  degraded  from  the  calibration 
period  (Tables  A-45  and  A-44).  The  one-and  two-standard  deviations 
from  simulated  mean  are  42  and  58  percent  respectively. 

5.1.10  Immigrat ion 

The  immigration  facility  displays  saturation  due  to  extremely 
heavy  demand.  This  feature  is  accurately  modeled  by  ALS1M  (Figure 
A-3~A).  However,  a  bias  error  in  the  transportation  time  from  the 
international  arrival  gates  produces  an  incorrectly  timed  rising 
slope  at  the  start  of  the  calibration  period.  During  the  time  of 
observation  at  Miami,  the  international  arriving  passenger  was 
transported  by  bus  from  gate  to  immigration.  The  simulation  model 
assumes  a  fixed  movement  speed  of  1  meter  per  second  from  point  to 
point  unless  input  data  indicates  a  different  travel  time. 
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Earlier  simulation  run  shown  in  the  next  Figure  (Figure  A-37B) 
indie  _e  an  early  simulated  arrival  by  using  the  default  value. 

A  correction  was  attempted  with  a  resulting  over  correction  shown 
here.  A  subsequent  run,  not  plotted,  indicated  a  proper  timing 
correction . 

The  earliest  arriving  international  flight  in  the  simulation 
schedule  is  at  1118.  Earlier  flow  in  the  field  data  is  due  to  non- 
simulated  arrivals.  The  model  requires  start-up  time  to  simulate 
passenger  deplaning  and  transit  time  to  this  facility.  Thus,  com¬ 
parisons  between  field  and  simulation  should  not  be  performed  for 
observations  of  deplaning  facilities,  such  as  immigration,  prior 
to  1145. 

The  numerical  comparison  indicates  a  large  number  of  field 
data  points  falling  outside  the  1-  and  2-  standard  deviation 
bounds  (Table  A-45  and  A-46).  However,  if  the  time  base  is  shifted 
such  that  the  simulated  time  1225  corresponds  to  1150  in  the  field 
data,  approximately  80  percent  of  the  field  data  points  fall  within 
2  standard  deviations  of  the  simulation  mean. 

VAL I  DAT  I ON 

The  model  and  field  data  both  represent  facility  saturation 
from  1405  to  1545  and  maintain  nearly  equal  processing  rates 
(Figure  A-38).  Simulated  flow  then  diverges  from  the  observed 
counts  by  decreasing  rapidly  figures.  Because  no  queue  length  data 
is  available,  it  is  impossible  to  determine  demand  levels.  The 
model  flow  decrease  from  1545  to  1555  occured  either  because  the 
earlier  demand  did  not  provide  a  sufficient  queue  length  to  main¬ 
tain  a  high  level  of  outflow  during  this  and  subsequent  times  or 
the  demand  occurring  from  1545  to  1655  is  incorrect.  The  modeled 
service  characteristics  did  not  change  during  this  time. 

Tabulated  flow  data  from  1605  to  1600  indicates  54  percent 
of  the  field  data  with  one  standard  deviation  of  the  simulated 
mean  and  "5  percent  within  two  standard  deviations  (Tables  A-4" 
and  A -48). 
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5.1.11  Customs 


The  customs  facility  follows  immigration  processing  with  an 
intervening  bag  claim  facility.  The  bias  time  correction  for  the 
rise  to  saturation  during  the  calibration  period  has  the  same  im¬ 
pact  at  customs  as  immigration.  Figures  A-39A  and  A-39B  respec¬ 
tively  indicate  the  rise  to  saturation  with  too  small  and  too 
large  an  estimate  of  travel  time  from  gate  to  immigration. 

If  the  time  axis  (Table  A-49  and  A-50)  is  displaced  to  place 
a  simulated  time  of  1225  to  correspond  to  an  actual  time  of  1150, 
80  percent  of  the  field  data  points  are  less  than  two  standard 
deviations  from  the  simulated  mean. 

VALIDATION 

The  bias  error  leading  to  in  correct  timing  of  the  increasing 
demand  during  the  calibration  period  was  corrected  for  validation. 
During  this  period,  the  simulation  service  rate  was  too  high. 

This  is  (Figure  A-40)  partially  due  to  an  error  in  specifying  the 
number  of  inspection  counters  open.  The  field  data  indicated  that 
8  counters  were  in  use  during  this  period.  The  corresponding 
simulation  input  was  10  counters. 

Tabulated  data  (Tables  A-Sl  and  A-52)  shows  only  16  percent 
of  the  field  points  in  the  one-standard  deviation  band  and  63 
percent  insid:  two  simulated  standard  deviations. 

5.1.12  Conclusions 
MIAMI 

o  For  most  facilities,  modeled  flow  tracks  the  field  data 
well.  Visual  inspection  indicates  agreement  in  direction 
and  general  magnitude  for  the  compared  time  series. 

o  Table  5-17  summarizes  the  percentage  of  flow  data  points 
within  1  and  2o  of  the  modeled  mean  value  during  the 
calibration  and  validation  time  periods.  Although  there 
are  some  facilities  where  the  corresponding  percentages 
change  markedly  from  calibration  to  validation,  most 
facilities  provide  consistent  results.  Thus,  if  model 


TABI.i:  5-17.  CALIBRATION  AND  VALIDATION  RESULTS 
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data.  (see  text) 


calibration  through  adjustments  or  service  characteristics 
is  performed,  an  accurate  flight  schedule  will  provide 
good  simulation  results. 

o  Although  the  model  did  exhibit  evidence  that  it  aid  not 
represent  each  facility  perfectly  and  provide  the  popula¬ 
tion  mean  and  variance,  several  facilities  exhibit  a  sub¬ 
stantial  percentage  of  points  within  2a.  An  overall  aver¬ 
age  was  approximately  75  percent  of  points  within  this 
limit . 

o  The  modeled  and  observed  queue  lengths  did  not  exhibit 

good  visual  agreement.  The  model  generally  underestimated 
the  magnitude  of  this  variable.  The  modeled  concourse 
security  stations  simulated  too  low  demand  levels.  This 
is  exhibited  by  output  flow  and  queue  lengths  which  are 
consistently  less  than  field  values.  At  check-in  counters, 
the  model  processes  the  simulateu  passengers  too  rapidly  • 
and  does  not  allow  queues  to  build.  Furthermore,  the 
initial  queue  length  at  these  facilities  is  not  well 
represented  by  the  model. 

o  For  cases  where  the  model  and  field  data  diverged,  it  is 
expected  that  closer  correlation  could  have  been  achieved 
upon  fine  tuning  of  input  parameters.  It  is  recommended 
that  any  application  of  ALSIM  be  performed  with  some  field 
testing  of  outputs  against  field  data  until  high  relia¬ 
bility  is  proven.  ALSIM  must  be  customized  for  any  airport 
and  limited  comparison  testing  is  recommended  before  any 
application. 

5.2  DENVER 

Validation  of  the  model  was  performed  for  Denver  Stapleton 
International  Airport,  using  data  collected  on  April  13,  1978.  The 
calibration  procedure  performed  for  this  airport  was  less  extensive 
than  for  Miami.  For  example,  no  attempt  was  made  to  modify 
reported  service  times  by  executing  the  model  for  a  calibration 
period,  then  performing  adjustments  of  the  distributions.  Instead, 
a  set  of  five  runs  was  performed  for  the  entire  six  hour  valida¬ 
tion  period.  Results  were  checked  for  obvious  input  errors  and 


corrections  made.  A  set  of  reruns  was  then  used  for  validation. 

All  of  the  major  carriers  serving  Denver  were  included  in 
the  survey;  thus  there  was  no  need  to  check  flight  schedules  with 
OAG  published  information.  Transfer  passenger  data  for  Continen¬ 
tal  arriving  flights  and  all  Braniff  flights  was  unobtainable. 

For  those  flights,  the  transfer  passenger  count  was  assumed  to  be 
30  percent  of  the  total  passenger  number. 

The  principal  distributions  used  in  the  simulation  of  Denver 
Stapleton  International  Airport  are  displayed  in  Tables  5-18 
through  5-24.  The  distribution  specifying  the  arrival  time  of 
originating  passengers  prior  to  flight  time  is  identical  to 
Miami's  and  is  contained  in  Table  5-3. 

Twelve  facilities  were  selected  for  performing  comparisons 
of  field  and  simulated  data.  These  were: 

1.  Security  at  Concourses  B,  C  and  D 

2.  United  Airlines  full  service  counter 

3.  Braniff  Airlines  full  service  counter 

4.  Frontier  Airlines  full  service  counter 

5.  Continental  Airlines  full  service  counter 

6.  Parking  facility  exit 

7.  Parking  facility  entrance 

8.  Recirculation  roadway 

9.  Enplaning  curb  Section  1 

10.  Deplaning  curb  Section  1. 

The  comparisons  were  only  performed  for  flow  counts  and  con¬ 
sisted  of  comparison  of  hourly  cumulative  values.  No  effort  was 
made  to  determine  if  the  field  data  was  within  one  or  two  simula¬ 
ted’  standard  deviations  of  the  simulated  mean.  Table  5-25  con¬ 
tains  the  hourly  summaries  of  field  and  simulated  counts  at  the 
processing  facilities.  At  each  time  block,  the  simulated  value 
appears  first,  followed  by  the  field  value.  The  third  quantity 
is  the  percentage  difference  expressed  as 
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TABLE  5-18.  TICKETING  CHECK  IN  TIME  (BRANIFF) 


CUMULATIVE 

PERCENT 

TIME 

(MINUTES) 

0 

0 

32 

1.25 

53 

2.25 

76 

4.25 

85 

5.25 

95 

7.25 

100 

12.25 

TABLE  5-19.  TICKETING  CHECK  IN  TIME  (WESTERN) 


CUMULATIVE 

TIME 

PERCENT 

(MINUTES) 

0 

0 

22 

1. 

41 

1.5 

68 

2. 

87 

3 

100 

5 
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TABLE  5-20.  GREETERS  PER  PARTY 


CUMULATIVE 

PERCENT 

47 

72 

91 

96 

99 

100 


NUMBER  OF 
GREETERS 

0 

1 

2 

3 

4 

5 


TABLE  5-21.  TICKETING  CHECK  IN  TIME  (UNITED) 


CUMULATIVE 

PERCENT 

0 

18 

45 

73 

84 

100 


TIME 

(MINUTES) 

0 

1 

2 

4 

6 

13.5 
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TABLE  5-22.  PASSENGERS  PER  PARTY 


CUMULATIVE 

PERCENTAGE 

60 

84 

93 

97 

98 

99 
100 


PASSENGERS 

1 

2 

3 

4 

5 

6 
7 


TABLE  5-23.  WELL  WISHERS  PER  PARTY 


CUMULATIVE 

PERCENTAGE 

82 

93 


NO  OF  WELL 
WISHERS 

0 

1 


98  2 

100  3 
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TABLE 


5-24.  PARKING  FACILITY  EXIT  SERVICE  TIME 


CUMULATIVE 

TIME 

PERCENT 

(SECONDS) 

0 

0 

11 

15 

53 

30 

85 

45 

92 

60 

100 

150 

5-39 


TABLE  5-25.  HOURLY  SUMMARIES  OF  COUNTS 
AND  PERCENTAGE  ERRORS 


CONCOURSE  B 

CONCOURSE  C 

TIME 

835  SIMUL 

791 

1405 

318  FIELD 

265 

-1500 

1621 

10% 

1505 

714 

557 

1600 

830 

737 

-14% 

-24% 

1605 

657 

427 

-1700 

720 

341 

-91 

25% 

1705 

532 

708 

-1800 

568 

935 

-  6  % 

-24% 

1805 

245 

775 

•1900 

494 

822 

-49% 

-6% 

1905 

185 

201 

•2000 

1029 

592 

-82% 

-66% 

CONCOURSE  D  UNITED  FULL  SERVICE 


365 

228 

372 

244 

2% 

7% 

325 

274 

294 

301 

10% 

12% 

389 

312 

551 

214 

-30% 

46% 

623 

267 

716 

155 

-13% 

59% 

707 

104 

673 

125 

4% 

-17% 

406 

45 

406 

105 

0% 

-75% 
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TABLE  5-25.  HOURLY  SUMMARIES  OF  COUNTS 
AND  PERCENTAGE  ERRORS  (CONTINUED) 


BRAN IFF  TICKET 

FRONTIER  TICKET 

CONTINENTAL  TICKET 

36 

64 

69 

60 

79 

35 

-40% 

-19% 

97% 

56 

49 

118 

78 

73 

62 

-28% 

-33% 

90% 

82 

69 

64 

103 

127 

64 

-20% 

-46% 

0% 

63 

134 

190 

54 

122 

98 

17% 

10% 

94% 

23 

158 

193 

4i 

115 

50 

-44% 

37% 

286% 

34 

123 

81 

45 

104 

65 

-24% 

18% 

25% 
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TABLE  5-25.  HOURLY  SUMMARIES  OF  COUNTS 
AND  PERCENTAGE  ERRORS  (CONTINUED) 


PARKING  EXIT 

PARKING  ENTRANCE 

RECIR.  ROADWAY 

ENPL  CORR 

DEPL  CORE 

150 

356 

72 

161 

99 

314 

231 

193 

395 

407 

5  2* 

54% 

-63% 

-59% 

-76% 

307 

490 

139 

223 

202 

231 

234 

197 

577 

447 

33  * 

109% 

-29% 

-61% 

-55% 

350 

549 

144 

193 

200 

338 

697 

210 

551 

371 

4% 

-21% 

-31% 

-65% 

-46% 

486 

595 

226 

260 

323 

468 

970 

253 

540 

491 

41 

-39% 

-11% 

-89% 

-34% 

3S1 

463 

190 

136 

284 

480 

491 

198 

415 

422 

=  211 

-5% 

4% 

-67% 

-32% 

527 

325 

251 

60 

440 

331 

412 

177 

478 

393 

591 

-21% 

34% 

-85% 

12% 
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100%  x 


Simulated-Field 

Field 


Large  percentage  differences  were  occasionally  observed  at 
several  facilities.  Consistently  large  differences  occured  at  the 
Continental  Airlines  ticket  counter  and  the  enplaning  and  deplaning 
curbside  areas.  The  Continental  ticket  counter  simulated  values 
are  appreciably  higher  than  those  observed.  The  percentage  of 
preticketed  passengers  input  for  Denver  was  53,  and  the  specific 
value  for  Continental  was  not  confirmed.  An  appreciably  higher 
value  of  the  input  parameter  could  explain  the  discrepancy. 

Tn^^jjnulat e d  vehicle  flow  counts  at  the  enplaning jincJ^-d-eplan- 
ing  curbs  ideswSre-^genera  1  ly  under-estimated,  wi  tjylatge  percentage 
differences  occurring!  Paj^king  f  aci  litygjvtrance  and  exit  flows 
are  in  good  general  agreement deficiency  appears  as  a 
result  of  too  few  vehic^le^-prfoceeding  ai'raotly  to  the  curbsides 
from  the  ai  rport^eniTrance .  There  are  a  signifTcTaiitJ/ylarge  number 
of  ho tel. -limousines  proceeding  to  these  curbs  and  these"may  be 
ow«l€r  represented  in  the  model. 

The  simulated  vehicle  flow  counts  at  the  enplaning  and  deplan¬ 
ing  curbsides  were  generally  underestimated,  with  large  percentage 
differences  occurring.  Parking  facility  entrance  and  exit  flows 
and  recirculation  roadway  flow  counts  exhibit  good  general  agree¬ 
ment,  thus  the  deficiency  appears  as  a  result  of  too  few  vehicles 
proceeding  directly  to  the  curbsides  from  the  airport  entrance. 

The  most  likely  explanation  for  the  discrepancy  is  the  improper 
simulation  of  limousines  for  car  rental  and  other  passenger  pick¬ 
up  and  drop-off  services.  The  model  only  dispatches  a  vehicle  of 
this  type  every  10  minutes.  The  mean  interarrival  times  of  these 
vehicles  are  undoubtedly  smaller. 

CONCLUSIONS 


ALSIM  generally  produced  good  flow  agreement  for  facilities 
within  the  terminal  building.  Curbside  demand  and  queueing 
phenomena  require  better  input  specification  to  utilise  this 
feature  of  ALSIM. 
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La  Guardi a 


Validation  procedures  for  this  airport  were  conducted  in  a 
manner  similar  to  those  applied  to  Denver.  There  was  no  model 
output  checking  performed  for  calibration  purposes.  Input  data 
service  time  distributions  were  taken  directly  from  field  observa¬ 
tions  and  converted  to  GPSS  functions.  Principal  distributions 
are  shown  in  Tables  5-26  through  5-34.  The  simulation  of  passen¬ 
gers  using  the  Eastern  Airlines  shuttle  was  performed  by  modeling 
them  as  passengers  of  an  airline  with  completely  independent 
facilities  with  no  transfers  simulated  between  the  shuttle  and 
other  airline.  Originating  passenger  arrival  times  prior  to  flight 
departures  were  sampled  form  the  distributions  used  for  Miami. 

For  the  simulation  of  LaGuardia,  the  service  time  distribution 
based  upon  observation  at  Eastern  full  service  ticketing  counters 
was  used  for  that  facility  type  regardless  of  airline.  The  cor¬ 
responding  express  check-in  service  time  distribution  was  obtained 
at  the  American  Counter  and  applied  universally  to  express  check¬ 
in  facilities.  At  security,  a  constant  8  second  per  person  ser¬ 
vice  time  has  used. 

The  data  used  for  model  comparison  was  obtained  on  May  24, 
1978  from  1400  to  2000.  Flight  schedules  were  provided  by  the 
airline  with  one  exception.  American  Airline  experienced  severe 
manpower  limitations  during  the  survey  period  and  only  provided  a 
list  of  inbound  flight  numbers  and  respective  deplaning  passengers 
for  flight  schedule  information.  Flight  times  of  arrivals, 
departure  times  and  enplaning  passenger  count  input  data  for  this 
airline  were  obtained  from  the  Official  Airline  Guide  using  proce¬ 
dures  identical  to  Miami. 

LaGuardia  Airport  was  simulated  from  1400  to  2000  with  no 
differentiation  made  between  calibration  and  validation  periods. 
Hourly  cumulative  flows  were  used  for  comparison  with  field  data. 
Simulation  output  was  checked  to  detect  gross  input  errors.  These 
errors  were  corrected  and  the  simulation  rerun.  Results  of  the 
rerun  series  are  summarized  for  the  twelve  facilities  chosen  for 
comparison  of  simulated  and  field  flows.  The  facilities  are 
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TABLE  5-26.  TICKETING  CHECK-IN  TIME 


CUMULATIVE  PERCENT 

0 

8 

19 

82 

91 

97 

100 


TIME  (MINUTES) 

0 

1 

2 

5 

6 

7 

8 


TABLE  5-27. 

CUMULATIVE  PRECENT 
0 

11 

54 

71 

82 

89 

100 


EXPRESS  CHECK-IN  TIME 

TIME  (MINUTES) 

0 

1 

2 

3 

4 

5 
8 
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TABLE  5-28.  CURBSIDE  CHECK-IN  TIME 


CUMULATIVE  PERCENT 

0 

17 

62 

81 

92 

100 


CHECK-IN  TIME  (MINUTES) 

0 

2 

4 

6 

9 

IS 


TABLE  5-29.  PARKING  EXIT  SERVICE  TIME 


CUMULATIVE  PERCENT 

SERVICE  TIME  (MINUTES) 

0 

0 

41 

0.25 

64 

.  5 

75 

1.25 

93 

5. 

100 

7. 
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TABLE  5-30.  GATE  SERVICE  TIME 


CUMULATIVE  PERCENT 

0 

43 

81 

97 

99 

100 


SERVICE  TIME  (MIN) 

0 

1 

2 

3 

4 

5 


FIGURE  5-31.  CAR  RENTAL  PROCESSING  TIME 


CUMULATIVE  PERCENT 

0 

39 

85 

96 

100 


PROCESSING  TIME  fMINUTES) 

0 

3 

6 

9 

13 
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TABLE  5-32.  PASSENGER  CROUP  SIZE 


CUMULATIVE  PERCENT 


NUMBER  OF  PASSENGERS 


TABLE  5-33.  WELL  WISHERS  PER  PASSENGER  GROUP 


CUMULATIVE  PERCENT 


NUMBER  OF  WELL  WISHERS 


99.6 
99.  9 
100.0 
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1.  Security  at  concourses  1,  2  and  3 

2.  American  full  service  counter 

3.  American  express  check-in  counter 

4.  United  full  service  counter 

5.  United  express  counter 

6.  Allegheny  full  service  counter 

7.  Eastern  full  service  counter 

8.  National  full  service  counter 

9.  TWA  full  service  counter 

10.  Airport  entrance  roadway. 

Results  of  the  hourly  flow  counts  are  summarized  in  Table 
5-35.  The  format  is  identical  to  that  used  for  Denver.  At  each 
time  block  the  field  flow  count  is  first,  followed  by  the  simula¬ 
tion  count  and  the  percentage  error  relation  to  the  field 

The  discrepancy  in  flow  counts  at  Concourse  1  is  due  to  lack 
of  knowledge  of  actual  departing  passenger  loadings  of  American 
Airlines.  Concourse  3  results  are  less  clear.  A  review  of  the  data 
provided  by  the  airline  and  the  airport  geometry  data  indicated 
the  correct  security  assignment  for  the  input  data  for  flights 
departing  from  this  concourse.  The  two  major  sources  of  discre¬ 
pancy  remaining  are  the  possibility  of  transfer  passengers  not 
leaving  the  concourse  for  performing  enplanements  and  the  possibil¬ 
ity  of  field  data  missed  counts.  The  airline  data  indicates  few 
transfer  passengers  on  this  concourse.  The  low  value  of  counts 
relative  to  other  concourses  makes  the  data  suspect. 

Simulated  flows  at  ticket  counters  produced  mixed  results. 

At  American  Airline  the  modeled  values  are  significantly  higher 
than  the  field  counterpart.  Because  Concourse  1  indicates  that 
these  simulated  passengers  are  less  than  those  observed,  the  large 
discrepancy  is  not  readily  explainable  from  the  use  of  synthetic 
passenger  loadings.  The  percentage  of  preticketed  passengers  and 
those  proceeding  directly  to  security  require  better  specification. 
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The  other  check  in  facilities,  the  discrepencies  between  field 
and  simulated  data,  are  not  consistently  positive  or  negative. 

Vehicular  flow  into  airport  entrance  roadways  is  consistently 
low  and  is  similar  to  the  experience  of  the  curbside  flow  at 
Denver.  The  ALSIM  input  data  responsible  for  generating  vehicular 
demand  is  not  adequate  to  explain  landside  entrance  flow.  The 
presence  of  airport  shuttle  vehicle  at  both  airports  requires 
further  investigation.  Employee  vehicle  at  LaGuardia  undoubledly 
contribute  to  the  entrance  flow  and  an  investigation  of  this 
factor  is  needed. 
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APPENDIX  A 


MIAMI  INTERNATIONAL  AIRPORT 
FACILITY  DATA 


The  figures  and  tables  contained  in  this  appendix  provide 
the  fime  series  comparisons  of  Miami  International  Airport 
facilities . 
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FIGURE  A  - 1 .  MIAMI  CONCOURSE  C  SECURITY  STATION  FLOW-CALIBRATION  PERIOD 


TABLE  A- 2.  CONCOURSE  C  FLOW:  CALIBRATION 
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TABLE  A- 3.  CONCOURSE  C  FLOW:  VALIDATION 
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TABLE  A-4.  CONCOURSE  C  FLOW:  VALIDATION 
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FIGURE  A-3.  MIAMI  CONCOURSE  D  SECURITY  STATION  FLOW- CAF,  I  BRAT  ION  PERIOD 
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TABLE  A- 6.  CONCOURSE  D  FLOW:  CALIBRATION 
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TABLE  A-8 .  CONCOURSE  D  FLOW:  VALIDATION 
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TABLE  A- 9 


E  FLOW:  CALIBRATION 
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TABLE  A-10 .  CONCOURSE  E  FLOW:  CALIBRATION 
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TABLE  A- 12.  CONCOURSE  E  FLOW:  VALIDATION 
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TABLE  A-1 3 .  CONCOURSE  F  FLOW:  CALIBRATION 
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_RUG_ 
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13 
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TABLE  A-14 .  CONCOURSE  F  FLOW:  CALIBRATION 
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TABLE  A- 15.  CONCOURSE  F  FLOW:  VALIDATION 
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TABLE  A- 16 .  CONCOURSE  F  FLOW:  VALIDATION 
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TABLE  A- 18.  CONCOURSE  G  FLOW:  CALIBRATION 
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1  SIMULATED  STD. 
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£  SIMULATED  STD. 

_DEU 
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15 
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35 
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TABLE  A - 1 9 .  CONCOURSE  G  FLOW:  VALIDATION 
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FIGURE  A- 19.  MIAMI  CONCOURSE  H  SECURITY  STATION  FLOW-CALIBRATION  PERIOD 


SE CUR  I T  r 


CONCOURSE  H  SECURITY  STATION  QUEUE  LENGTH- CALIBRATION  PERIOD 
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FIGURE  A- 22.  MIAMI  CONCOURSE  H  SECURITY  STATION  QUEUE  LENGTH -VALIDATION  PERIOD 
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FIGURE  A-37B.  MIAMI  IMMIGRATION  FACILITY  FLOW-CALIBRATION  PERIOD 
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FIGURE  A- 38.  MIAMI  IMMIGRATION  FACILITY  FLOW- VAL IDATION  PERIOD 
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-39B.  MIAMI  CUSTOMS  FACILITY  FLOW-CALIBRATION  PERIOD 


TABLE  A-49.  CUSTOMS  FLOW:  CALIBRATION 


’■  .1 

■  i  -  '**» 

J  *?  J  '**  *  ■ 

‘  .J.7/V 

5 

1 7  ; 

7 ' 7  r  •  r  *' 

1: 

1  5 

3 

0 

> 

J 

0 

0.04 

0  .  3  0 

1  i 

2  ) 

•j 

3 

> J 

J 

0 

0.07 

7.43 

1 1 

2  [j 

7 

.7 

) 

) 

r», 

7.  DC 

4.74 

i  i 

0 

:> 

3 

o 

0 

0.07 

0.0  3 

i  i 

3  5 

3 

7 

J 

7 

7 

0.04 

7.00 

i  i 

4  3 

7 

3 

0 

0  .  .7  0 

7.0  3 

1 1 

4  5 

o 

3 

0 

3 

7.0) 

v'  .  7  7 

i  i 

5  3 

j 

7 

,7 

2* 

0.70 

0  .  4  J 

i  i 

3  3 

7 

3 

3 

3 

0. 07 

7.74 

i  .? 

7  7 

) 

3 

£ 

7.07 

7.77 

i  : 

4  5 

0 

t 

3 

7 

7 

7  .  77 

7.07 

1  2 

1  J 

7 

12 

17 

i  ^ 

7 

7.77 

5.7  7 

1  2 

1  5 

3  *■ 

2  4 

32 

7  ? 

2  7 

2  0.83 

4.34 

i : 

2  3 

12 

17 

IS 

2  < 

17.33 

7.4  7 

i  ? 

2  5 

o 

1  2 

5 

32 

1  0 . 4  3 

12.72 

17 

3  7 

1  * 

4  7 

7'J 

3  l 

3  7 

4  7.43 

11.73 

1  2 

3  3 

4  7 

3  3 

5  2 

4  7 

4  i 

4  4.  7  j 

•7.10 

1  7 

*7 

5  3 

5  4 

4  7 

7  J 

4  7 

54.77 

12.57 

12 

4  3 

3  *5 

3  2 

7  j 

7  r 

4  3 

5  .  4  0 

7.54 

1  2 

5  ' 

3  2 

4  2 

3  3 

5  7 

73 

5  7.27 

2  0.32 

1  2 

5  7 

3 :» 

5  3 

7  4 

5:) 

77 

57 . 20 

1  5  •  4  .j 

1  2 

J  J 

3  r» 

j 

4  : 

3  3 

3  4 

61.3  ) 

21.77 

1  5 

1  *; 

5  4 

4  3 

72 

5  3 

5  J 

5  3 . 4  7 

2.53 

1  3 

1  * 

4  3 

3  3 

7  7 

J  .7 

5  4 

^  )  •  «  v 

15.73 

1  3 

1  5 

j  4 

4  2 

3  4 

4  o 

S  5 . 0  ) 

1  7 . 0  f 

1  3 

2  7 

3  2 

7  7 

7  3 

7-3 

7  3 

7  4  .  -J  ') 

5.  ) 2 

1  2 

23 

j  -! 

<  7 

5  ? 

7  2 

3  i 

3  7.37 

10.03 

1  3 

3 ; 

5  > 

j  7 

4 

4  3 

52 

*1.77 

17  .  01 

1  3 

3 

7  3 

3  i 

5  3 

5  4 

5  7.27 

15.5  v> 

1  3 

4  1 

r> 

S  7 

5  4 

J  + 

7  0 

3  0.30 

13.47 

13 

'4  5 

4  2 

3  4 

4  4 

4  7 

5  2 

5  3  .  J  0 

17.70 

1  3 

5 : 

7  4 

4  7 

•4  ; 

j 

5  » 

17  0 1 

1  4  »  '■  4 

1  3 

D  7 

5  2 

j  j 

7  7 

7  4 

32 

5  '  .  30 

5.73 

1  '*> 

J  * 

7  7 

72 

)  • 

7  j 

7  0 

3  7.83 

10.71 

A-91 


TABLE  A- 50.  CUSTOMS  FLOW:  CALIBRATION 
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APPENDIX  B 

SENSITIVITY  ANALYSIS  FOR  THE 
LANDSIDE  SIMULATION  MODEL 
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B-l  ALSIM  SENSITIVITY  ANALYSIS 


Sensitivity  analysis!/  is  an  important  part  of  model 
development,  calibration,  and  application.  Several  examples 
of  its  use  with  the  LSM  are: 

•  to  determine  how  accurately  an  input  parameter 
must  be  specified; 

•  to  forecast  the  implications  of  a  change  that  is 
expected  in  the  airport  landside  system; 

•  to  estimate  the  implications  of  alternative  poli¬ 
cies  for  or  physical  changes  to  the  airport  land- 
side  system;  and 

•  to  quantify  the  tradeoff  between  level  of  service 
and  capacity  in  the  airport  landside  system. 

These  examples  are  expanded  below. 

B.1.1  Analysis  to  Obtain  Required  Accuracy  of  Input  Parameter 

The  most  costly  and  time-consuming  aspect  of  using  AISIM 
is  the  collection  of  data  necessary  for  calibration  of  the  model. 
Typically,  anywhere  from  50  to  150  observers  are  needed  for  two  or 
more  days  to  obtain  just  the  primary  data.  Additional  resources 
are  consumed  reducing  the  data  and  entering  it  as  input.  As 
differences  arise  between  the  model's  outputs  and  real-world  observations, 
more  data  may  be  needed  to  resolve  the  discrepancies. 

If  a  model  user's  interest  is  restricted  to  a  limited 
part  of  the  airport,  such  time  and  effort  in  data  collection 


1/  Sensitivity  analysis  is  the  study  of  how  model  outputs 
change  in  response  to  changes  in  input  parameters. 
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and  model  calibration  may  be  saved  by  performing  sensitivity 
analyses  on  parameters  hypothesized  to  have  little  impact  on 
the  areas  of  interest. 

For  example,  if  Concourse  A  is  the  focus  of  interest, 
it  may  be  unnecessary  to  describe  accurately  the  geometry, 
security  systems,  gate  areas,  and  baggage  claims  at  Con¬ 
course  B.  To  save  money,  time,  and  effort,  a  two-phase  data 
collection  approach  could  be  used.  In  the  first  phase, 
detailed  data  would  be  obtained  only  for  Concourse  A.  Rough 
data  (such  as  number  of  gates,  security  stations,  and  bag¬ 
gage  claim  areas)  would  be  collected  for  Concourse  B.  The 
model  would  then  be  run  using  default  values  for  the  missing 
data  (e.g.,  service  rate  per  security  station  from  Concourse 
B.  Further  runs  would  be  made  altering  the  default  values 
to  observe  the  impact  of  such  alternatives  on  the  outputs 
for  Concourse  A.  If  there  were  no  impact  or  if  the  impact 
were  as  minimal,  additional  data  collection  could  be  fore¬ 
gone  and  default  values  assumed  at  a  great  savings  in  time 
and  expense. 

B.1.2  Analysis  to  Forecast  the  Implications  of  Expected  Changes 

Sensitivity  analyses  may  be  used  to  forecast  the  impli¬ 
cation  of  expected  changes  at  the  airport  if  these  changes 
do  not  simultaneously  affect  too  many  of  the  parameters  of 
the  model.  For  example,  it  can  be  used  to  analyze  the  im¬ 
pact  of  a  breakdown  of  a  security  X-ray  system.  It  could 
also  be  used  to  forecast  the  implications  of  a  new  carrier's 
serving  the  airport  with  a  few  flights  per  day.  Such  an 
>  analysis  would  be  the  basis  for  deciding  whether  additional 
facilities  would  be  required,  and  could  be  a  prelude  to 
further  use  of  the  model  for  examining  the  implications  of 
proposed  changes. 


B.1.3  Analyses  to  Support  New  Policy  or  New  Construction 

As  problems  arise  at  the  airport  groundside,  airport 
and  airline  officials  seek  to  alleviate  them  by  various 
means.  In  most  cases,  the  first  step  is  to  identify  the 
problem  and  to  propose  alternative  solutions.  The  second 
step  is  to  analyze  the  alternatives  and  select  the  best  one. 
Because  there  are  few  quantitative  tools  available  for  this 
type  of  analysis,  there  is  generally  no  easy  way  to  rank  the 
alternatives  nor  to  determine  whether  or  not  a  given  choice 
will  even  succeed  in  solving  the  problem.  Sometimes,  solu¬ 
tions  selected  will  simply  move  the  problem  from  one  part  of 
the  airport  to  another  (for  example,  limiting  curbside  dwell 
time  may  move  a  congestion  problem  from  the  curbside  to  the 
short-term  parking  lot) . 

If  the  airport  planner  has  a  calibrated  LSM  at  his 
disposal,  policy  or  construction  solutions  may  be  studied 
quantitatively  via  sensitivity  analysis.  Generally,  each 
solution  will  be  represented  by  a  change  in  one  or  more  of 
the  input  parameters.  As  these  parameters  are  varied,  the 
model  user  may  trade  off  effectiveness  (measured  by  quality 
of  service)  versus  the  cost  of  proposed  change. 

B.1.4  Sensitivity  Analysis  for  Capacity  Studies 

Sensitivity  analyses  may  be  used  to  quantify  the  trade¬ 
off  between  level  of  service  and  capacity,  for  the  whole,  or 
for  selected  portions,  of  the  airport  landside.  By  selec¬ 
tively  changing  the  airline  schedule  or  the  loads  on  sched¬ 
uled  flights,  it  is  possible  co  determine  how  well  the  air¬ 
port's  landside  level  of  .  .e  is  maintained  as  the  demand 
upon  it  increases.  If  a  leve.  t  service  "standard"  is 
arbitrarily  set,  the  associated  airport  capacity  can  be 
determined  by  increasing  or  decreasing  demand  until  the 
desired  standard  is  achieved. 


B.2  PARAMETERS  FOR  SENSITIVITY  ANALYSIS 


Sensitivity  analyses  may  be  performed  on  any  LSM  inputs 
or  any  combination  of  inputs.  What  parameter  you  need  to 
vary  will  depend  on  what  question  you  are  trying  to  answer 
or  what  problem  you  are  trying  to  solve.  A  representative 
list  of  parameters  for  sensitivity  analysis  is  presented  in 
Table  1.  These  are  discussed  in  more  detail  below. 

Passengers/flight  is  a  parameter  that  may  be  varied  to 
examine  how  changes  in  demand  will  affect  the  airport  land- 
side.  Passengers/flight  may  be  varied  to  trace  the  tradeoff 
between  capacity  and  level  of  service ,  as  described  in  Sec¬ 
tion  B.4,  or  to  identify  what  facilities  are  most  likely  to 
be  the  first  to  saturate  as  airport  volumes  grow.  Since  the 
number  of  passengers  must  be  specified  for  each  incoming  or 
outgoing  flight,  this  parameter  can  be  changed  on  selected 
flights  only  in  order  to  study  the  effects  of: 

•  policies  that  might  spread  the  peaking  of  demand; 

•  changes  in  equipment  type  on  selected  flights;  and 

•  holiday  peaking  of  traffic. 

The  percentage  of  passengers  who  are  preticketed  is  a 
figure  generally  beyond  the  control  of  the  airport  planner. 
However,  the  airlines  may  have  some  control  over  this  para¬ 
meter  by  offering  low-fare  incentives  to  passengers  who 
purchase  tickets  in  advance.  In  any  case,  this  parameter 
may  change  over  time  and  tends  to  vary  by  carrier.  Its 
,  change  has  implications  for  the  level  of  service  at  the 
check-in  counter  and  at  the  curbside. 
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Table  1 

INPUT  SENSITIVITY  PARAMETERS 

1.  Passengers/Flight 

2.  Percentage  Preticketed 

3.  Percentage  Using  Express  Check 

4.  Modal  Choice 

5.  Greeters/Group 

6.  Well -Wisher s/Group 

7.  Bag  Distribution 

8.  Service  Time  Distribution 

9.  Number  of  Servers 
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Changes  in  the  percentage  of  passengers  using  the  express 
check-in  service  can  be  affected  by  the  percentage  pre ticketed, 
by  the  quality  of  curbside  check-in,  by  the  length  of  lines 
at  the  express  versus  full-check-in  counter,  and  by  customer 
service  agents  who  direct  traffic  at  the  check-in  area. 

Changes  in  this  parameter  will  affect  the  level  of  service 
at  both  express  and  full  check-in  facilities,  and  may  poten¬ 
tially  affect  the  level  of  service  at  the  concourse  security 
check. 

Changes  in  passengers'  modes  of  access  will  affect  the 
parking  lots  and  the  curbside,  and  may  affect  check-in  and 
security  facilities  (because  increasing  the  number  of  arri¬ 
vals/vehicle  increases  the  "bunching"  of  passengers  at  these 
facilities) . 

The  distribution  of  greeters/arriving  group  of  passen¬ 
gers  and  well-wishers/departing  group  bears  on  the  level  of 
congestion  at  various  points  throughout  the  airport.  Their 
impact  is  also  dependent  on  other  parameters  not  listed  in 
Table  1,  such  as  the  percentage  of  greeters  who  meet  their 
arriving  party  at  the  gate  (these  greeters  must  go  through 
security  and  park  their  cars)  versus  the  percentage  that 
meet  their  party  at  security  (these  greeters  park  their 
cars)  versus  the  percentage  that  meet  their  party  at  the 
curbside. 

The  distribution  of  bags/passenger  affects  the  activity 
at  the  bag  claim  facility  and  potentially  the  lines  at  the 
parking  lot  exit. 

Service  time  distributon  and  number  of  servers  affect 
the  capacity  and,  therefore,  the  flows  and  queues  at  each 
facility.  In  the  real  world,  service  time  and  number  of 
servers  are  often  readily  subject  to  change,  either  by  add¬ 
ing  staff,  improving  the  training  or  supervision  of  staff, 
or  changing  the  amount  or  type  of  equipment.  Consequently, 
service  time  distribution  and  number  of  services  are  common 
subjects  for  sensitivity  analysis. 


B. 3  HOW  TO  PERFORM  SENSITIVITY  ANALYSES 


B.3.1  The  Direct  Approach 

The  direct  approach  to  performing  sensitivity  analyses 
on  the  LSM  is  to  vary  the  parameter  of  interest  and  to  do  as 
many  runs  for  each  value  of  the  parameter  as  is  necessary  to 
obtain  statistical  bounds  on  the  outputs  of  interest.  How¬ 
ever  ,  since  a  minimum  of  3  to  5  runs  are  needed  for  each 
value  of  the  parameter,  and  since  the  parameter  will  prob¬ 
ably  require  3  to  5  values  to  cover  the  range  of  interest, 
between  9  and  25  runs  are  needed  (perhaps  even  more)  to 
perform  sensitivity  analyses  on  even  one  parameter.  Although 
single  runs  of  the  model  are  not  expensive,  the  price  of  one 
sensitivity  analysis  could  exceed  its  worth,  and  analyses  of 
so  many  runs  is  tedious  and  expensive.  Consequently,  the 
following  approach  is  suggested,  whenever  possible,  to  reduce 
the  time  and  cost  of  performing  sensitivity  analyses. 

B.3.2  Combined  Analytic /Simulation  Approach 

This  approach  seeks  to  reduce  the  number  of  model  runs 
needed  by  analytically  estimating  the  relationship  between 
the  input  parameter  and  output  of  interest.  This  relation¬ 
ship  is  then  verified  by  running  the  model.  This  signifi¬ 
cantly  reduces  the  number  of  runs  needed.  Two  examples  of 
this  approach  are  presented  below. 

B.3.2.1  Sensitivity  Analyses  on  Facility  Service  Time 

This  example  is  based  upon  five  base-case  runs  of  the 
LSM  at  Miami  International  Airport. 

The  problem  was  to  determine  how  much  the  distribution 
of  service  times  would  have  to  change  in  order  to  produce 
.queues  at  facilities  which  currently  do  not  have  any  and  to 
eliminate  queues  at  facilities  which  currently  have  them.  A 
list  of  facilities  of  interest  is  shown  in  Table  2. 


Table  2 

SENSITIVITY  ANALYSIS 
Average  Service  Time 


Concourse  B  Security 
Concourse  C  Security 
Concourse  D  Security 
Concourse  E  Security 
Concourse  F  Security 
Concourse  G  Security 
Concourse  H  Security  ? 
Immigration  X 

Customs 
Parking  Lot  1 
Parking  Lots  4  &  5 
Ticketing  EA 
Ticketing  TW  &  SO 
Express  Check-In  EA 


?  X 


X  X 

X  X 

X  X  X  X  X 

x  x  X  x  x 

?  X  X  X  X 

XXX 
•> 


X 


X  indicates  congestion  probable 
?  indicates  congestion  possible 


The  first  step  was  to  estimate  the  capacities  of  the 
facilities  of  interest.  This  was  done  by  averaging  the 
time/transaction  (per  the  GPSS  output)  over  the  five  runs, 
dividing  the  result  into  300  (seconds)  to  derive  transac- 
tions/server/f ive-minute  period,  and  multiplying  by  the 
number  of  servers  to  derive  transactions/five-minute  period. 
Finally,  the  result  was  multiplied  by  persons/transaction  to 
derive  persons/five-minute  period.  These  calculations  are 
shown  in  Table  3. 

The  second  step  was  to  estimate  the  peak  demand. 

Since  only  a  sustained  peak  would  lead  to  more  than  a  tran¬ 
sient  queue,  the  highest  twenty-minute  flows  were  obtained 
and  averaged  over  the  five  runs.  The  result  was  divided  by 
four  to  derive  the  number  of  persons  processed/five-minute- 
period.  These  calculations  are  shown  in  Table  4. 

Where  capacity  exceeded  peak  flows,  it  was  assumed  that 
capacity  could  be  reduced  to  the  peak  flow  before  signifi¬ 
cant  queues  would  begin  to  form.  Capacity  reduction  of  X% 
could  be  achieved  by  increasing  service  times  by  X%.  Conse¬ 
quently,  the  point  at  which  queues  could  be  expected  to 
start  forming  could  be  calculated  in  a  straightforward  fash¬ 
ion. 

When  peak-flows  exceeded  "capacity"  it  was  assumed  that 
peak  flow  was  not  an  appropriate  measure  of  peak  demand. 

Peak  demand  was  estimated  at  capacity  plus  the  maximum  rate 
of  queue  buildup.  The  rate  of  queue  buildup  was  defined  as 
the  change  in  queue  length  over  at  least  three  (five-minute) 
periods  divided  by  the  number  of  periods.  These  computa¬ 
tions  are  shown  in  Table  5. 
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Table  4 

CALCULATION  OF  AVERAGE  SUSTAINED  PEAK 


Average 


Facility 

Peak 

20-Minute 

Flow 

5-Minute 

Pec'"JL/ 

Run  1 

Run  2 

Run  3 

Run  4 

Run  5 

(1) 

(2) 

(2) 

(4) 

<$) 

(6) 

O) 

Security  B 

258 

226 

234 

224 

234 

58.8 

Security  C 

274 

294 

244 

280 

254 

67.3 

Security  D 

184 

116 

124 

124 

126 

33.7 

Security  E 

230 

220 

224 

202 

234 

55.5 

Security  F 

150 

146 

152 

146 

142 

36.8 

Security  G 

398 

368 

394 

398 

370 

96.4 

Security  H 

216 

238 

218 

226 

224 

56.0 

Immigration 

300 

336 

294 

312 

312 

77.7 

Customs 

274 

306 

270 

238 

260 

67.4 

EA  Full  Service 

156 

194 

178 

186 

188 

45.1 

EA  Express 

156 

138 

132 

154 

166 

37.3 

TW  &  SO  Full  Service 

54 

46 

62 

72 

68 

15.1 

Parking  1  Exit 

94 

96 

94 

104 

100 

24.4 

Parking  4  &  5  Exits 

232 

208 

212 

206 

212 

53.5 

1/  Computed  as:  (Sum  of  columns  2  through  6)  *  20. 


Table  5 

ESTIMATION  OF  DEMAND  PEAK  USING  RATE  OF  QUEUE  BUILDUP 


Item 

(1) 


1. 

Peak 

Queue 

Buildup, 

Run 

2. 

Peak 

Queue 

Buildup, 

Run 

3. 

Peak 

Queue 

Buildup, 

Run 

4. 

Peak 

Queue 

Buildup, 

Run 

5. 

Peak 

Queue 

Buildup, 

Run 

6. 

Peak  Queue 
Average 

Buildup, 

7. 

Average  Capacity!/ 

8. 

Estimated  Demand  Peak!/ 

Facilities  with  Significant  Queues 
Customs  Immigration  Security  H 


(2) 

(3) 

(4) 

15.0 

59.5 

38.0 

37.3 

78.0 

36.0 

16.0 

97.0 

32.0 

24.0 

72.5 

50.0 

19.3 

93.5 

39.0 

22.3 

80.1 

39.0 

61.4 

70.4 

51.2 

83.7 

150.5 

90.2 

1/  Table  3,  Column  6. 
2/  Lines  6  plus  7. 
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Table  6  shows  the  computations  used  to  estimate  what 
percentage  changes  in  capacity  are  needed  to  bring  about  a 
change  in  the  queue  status  of  each  facility.  Table  2  pre¬ 
sents  these  date  in  another  light  by  showing  whether  or  not 
queues  will  exist  at  each  facility  as  service  time  is  varied 
by  the  "service  time  multiplier." 

Table  6  now  forms  a  basis  for  sensitivity  analysis. 
Note,  however,  that  service  time  distribution  changes  affect 
not  only  the  mean  service  time,  but  also  the  variance  in 
service  time.  Since  the  variance  in  service  time  will  af¬ 
fect  queuing,  the  analyses  above  will  not  be  "exact."  Fur¬ 
thermore,  the  analyses  do  not  show  the  maximum  length  of 
queues  as  mean  service  times  vary,  nor  other  outputs  of 
interest.  These  outputs  may,  of  course,  be  estimated  analy¬ 
tically  as  well,  but  this  is  a  more  difficult  task  requiring 
the  comparison  of  demand  to  capacity  over  time.  Some  addi¬ 
tional  model  runs  will  be  desired  to  "validate"  the  analyti¬ 
cal  approach  and  perhaps  to  provide  more  quantitative  data 
on  queue  length,  delay  time,  and  other  outputs  of  interest. 

B.3.2.2  Sensitivity  Analyses  on  Percentage  Preticketed 

Figure  1  shows  the  flow  of  preticketed  and  nonticketed 
passengers  in  the  LSM  simulation  of  Eastern  Airlines  at 
Miami  International  Airport.  Nonticketed  passengers  are 
assumed  to  use  the  full-service  check-in  counters.  Seventy 
percent  of  preticketed  passengers  are  assumed  to  use  the 
express  check-in  facility.  Some  of  the  remaining  thirty 
percent,  are  assumed  to  check  their  bags  at  the  curb  and 
proceed  to  security  clearance,  and  some  are  assumed  to  go 
directly  to  security.  Curbside  check-in  queues  are  not 
output  by  the  LSM.  However,  queues  at  the  express  and  full- 
service  check-in  facilities  are  of  interest.  The  question 
is,  "how  much  can  the  percent  preticketed  be  varied  from  its 
base  of  55  before  queues  become  substantial  at  either  the 
express  or  full  check-in  facility." 
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Table  6 

COMPARISON  OF  CAPACITY  VERSUS  DEMAND  PEAK 


Facility 

Demand 

Capacity 

Peak  Demand 

(1) 

(2) 

(3) 

(4) 

Security  P 

58.8 

64.1 

1.09 

Security  C 

67.3 

103.8 

1.54 

Security  D 

33.7 

45.5 

1.35 

Security  E 

55.5 

55.4 

1.00 

Security  F 

36.8 

49.3 

1.34 

Security  G 

96.4 

100.0 

1.04 

Security  H 

90.2 

51.2 

0.57 

Immigration 

150.5 

70.4 

0.47 

Customs 

83.7 

61.4 

0.73 

EA  Full  Service 

45.1 

67.8 

1.50 

EA  Express 

37.3 

44.6 

1.20 

TW  &  SO  Full  Service 

15.1 

27.8 

1.84 

Parking  1  Exit 

24.4 

23.5 

0.96 

Parking  4  &  5  Exits 

53.5 

69.6 

1.30 
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Figure  1 

PERCENT  PRETICKETED 


PRETICKETED 

PAX 


The  answer  is  readily  derived  from  the  demand/capacity 
analyses  of  Table  6.  To  obtain  queuing  at  the  Eastern  ex¬ 
press  facility,  the  demand  would  have  to  be  increased  by 
20%.  This  means  that  the  number  of  preticketed  passengers 
would  have  to  increase  by  20%.  Thus,  if  the  percentage  of 
preticketed  passengers  were  to  increase  from  55  to  66  (a  20% 
increase),  queues  could  be  expected  to  develop. 

Similarly,  Table  6  shows  that  demand  could  increase  by 
50%  at  the  full-service  counter  before  significant  queues 
would  develop.  Consequently,  the  percentage  nonticketed 
would  have  to  increase  from  45  to  67.5  and  the  percentage 
preticketed  would  have  to  decrease  to  32.5  in  order  to  cre¬ 
ate  queuing  at  the  full-service  counter.  Of  course,  these 
results  must  be  verified  by  LSM  runs. 
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